EVF Advanced Tutorial

Specify Schema on Open

Our first-cut implementation used a "late schema" approach: we created columns on the fly. However, the log reader actually knows the schema up-front; it is specified in the plugin configuration. We can exploit that fact to create a more robust implementation.

((Need code))

Enhance Error Messages

((TO DO))

Support an External Schema

The log format plugin was created prior to the EVF. As a result, the only way it could provide a schema was via the plugin configuration. Starting in 1.16, Drill provides a [schema provisioning](need link) mechanism so we can decouple our file schema from the plugin configuration: we don't have to define a new config for each new kind of file: we can associate the schema with the file.

((Need details))

Support File-Specific Properties

The log format plugin normally defines the file regex in the plugin config. Continuing to build on the Drill 1.16 schema provisioning mechanism, we can instead associate the regex with the table.

((Need details))