Can I use SQL Bulk Copy but exclude rows that don't met a certain set of criteria?

[VictorioBerra]

Lets say using the example here I did not want to include a row if the Column OpenPrice was < 100.00.

Is this possible?

[phatcher]

@VictorioBerra Not easily no, since the ColumnHeader functionality is more about mapping CSV columns to SQL columns.

What I think would be needed is to extend CsvReader with a Func<Row, bool> delegate that would be evaluated by NextRecord, so it would only return true if the row is to be returned.

[VictorioBerra]

@phatcher thanks for the quick reply. I will see what I can do.

[VictorioBerra]

I put my Func evaluate code here but im having some trouble "skipping" the current row depending on if it was true/false

https://github.com/phatcher/CsvReader/blob/master/code/LumenWorks.Framework.IO/Csv/CsvReader.cs#L1618

if(Filter != null)
{
    var shouldKeepRecord = Filter.Invoke(this);
    if (!shouldKeepRecord)
    {
        // Causes a row to be skipped?
        SkipToNewLine(ref _nextFieldStart);
    }
}

I tried SkipToNewLine() but that just skipped the line after and the very last line. I am using the reader like this currently:

 foreach (var fileName in files)
{
    Logger.Info(string.Format("Reading in File: {0}", fileName));

    using (var reader = new CsvReader(new StreamReader(fileName), true, (fields) => {

    var someNumberField = fields[0];

    if (someNumberField == 10000)
    {
        // Return true to keep a row
        return true;
    }

    //return false to discard this row
    return false;
}))
    {

        using (var outputStream = new StreamWriter(@"C:\Users\toryb\Downloads\CsvReader Output\output.txt"))
        {
            while (reader.ReadNextRecord())
            {
                var sb = new StringBuilder();
               // ... removed for brevity ...

                outputStream.WriteLine(sb.ToString());
            }
        }
    }

[VictorioBerra]

So I think maybe this works when placed after this line?

                if (Filter != null)
                {
                    var shouldKeepRecord = Filter.Invoke(this);
                    if (!shouldKeepRecord)
                    {
                        return ReadNextRecord(false, true);
                    }
                }