Skip to content

Version 1.4.0
Compare
Choose a tag to compare
@falaki falaki released this 04 Mar 19:46
· 10 commits to master since this release
v1.4.0
cbc72fe

CSV Data Source for Spark Version 1.4.0

Features

  • Support for specifying custom date format for date and time (by @HyukjinKwon)
  • Support for quote mode (by @tobithiel)
  • Support for Boolean in type inference (by @yucheng1992)

Improvements

  • Fixed setting escape character with none quoteMode (by @d18s)
  • Several documentation improvements (by @HyukjinKwon and @tanwanirahul)
  • Fixing negative index bug when user specified manual schema and data has missing fields (by @HyukjinKwon)
  • Support for blank lines (by @HyukjinKwon)
  • Support for short names in compression codec (by @HyukjinKwon)
  • Fixed a corner case with type inference (by @tanwanirahul)
  • Support for dropping malformed rows for TimestampType and DateType types (by @HyukjinKwon)
  • Support for escaping null value during parsing (by @addisonj)
  • Testing against Saprk 1.6.0 (by @HyukjinKwon)
Assets 2
Loading