Quantcast
Channel: Read parquet files in Spark with pattern matching - Stack Overflow
Browsing latest articles
Browse All 2 View Live

Answer by Tal Joffe for Read parquet files in Spark with pattern matching

you can use wildcard in parquet like so (works on 1.5 didn't test on 1.3):val v1 = sqlContext.parquetFile("hdfs://myhost:8020/user/hive/warehouse/db/blogs/yymmdd*")another thing you can do in case that...

View Article



Read parquet files in Spark with pattern matching

I'm running Spark 1.3.0 and want to read a number of parquet files based on pattern matching. the parquet files are basically the underlying files of a Hive DB and I want to read some of the files...

View Article
Browsing latest articles
Browse All 2 View Live




Latest Images