[enhancement] loadFlatMap

[김승갑]

yaml object → flatMap

// yaml
a:
  b: 1
  c: 2
  d: 
    e: 5

// map
"a.b" to 1
"a.c" to 2
"a.d.e" to 5

‌

[Andrey Somov]

The words help to explain yourself.

[김승갑]

@Andrey Somov I created PR! https://bitbucket.org/snakeyaml/snakeyaml/pull-requests/18/542-feat-loadflatmap

[Alexander Maslov]

@김승갑 I can imaging why you want this kind of map, but I do not think it belongs to this library as a core function.
You can do exactly the same outside of snakeyalm. Apply your flatMap to Map<String, Object> loaded using snakeyaml.

Just like you do in pull request #18.

[김승갑]

@Alexander Maslov

right. but, yaml → flatMap is useful in configuration (spring, apache, ..)

if you don’t need to this pr.

close this~

[김승갑]

spark:
  sql:
    crossJoin.enabled: true
    hive.convertMetastoreOrc: false
    sources.partitionOverwriteMode: dynamic
    broadcastTimeout: 36000
    autoBroadcastJoinThreshold: -1
    legacy:
      parquet:
        int96RebaseModeInRead: CORRECTED
        int96RebaseModeInWrite: CORRECTED
        datetimeRebaseModeInRead: CORRECTED
        datetimeRebaseModeInWrite: CORRECTED
      timeParserPolicy: LEGACY
      storeAssignmentPolicy: LEGACY

hive:
  exec:
    dynamic.partition: true
    dynamic.partition.mode: nonstrict
  metastore:
    client:
      factory:
        class: com.amazonaws.glue.catalog.metastore.AWSGlueDataCatalogHiveClientFactory

‌

[김승갑]

https://spark.apache.org/docs/latest/configuration.html#application-properties

spark.app.name	(none)	The name of your application. This will appear in the UI and in log data.	0.9.0
spark.driver.cores	1	Number of cores to use for the driver process, only in cluster mode.	1.3.0
spark.driver.maxResultSize

‌

[Alexander Maslov]

This seems to be an interesting use case, but not for the general yaml parsing library.

You can post/pre porcess maps you are dumping and loading to achieve what you need.

[김승갑]

I agree, thanks for comment.