skipRows does not skip rows for readCSV when CSVs have new lines

[mbornstein]

Have you tried latest version of polars?

• yes

What version of polars are you using?

0.16.0

What operating system are you using polars on?

Mac OS 15.1 (24B83)

What node version are you using

using Bun v 1.1.37

Describe your bug.

Give a high level description of the bug.

What are the steps to reproduce the behavior?

here is a test

it("repro ", () => {
  const df = pl.readCSV(
    dedent`
    "name
    a","height
    b"
    "John",172.23
    "Anna",1653.34
  `,
    { quoteChar: "\"", sep: ",", hasHeader: false, skipRows: 1 },
  )
  expect(df.toRecords()).toEqual([
    { "column_1": "John", "column_2": 172.23 },
    { "column_1": "Anna", "column_2": 1653.34 },
  ])
})

produces:

60 |     "John",172.23
61 |     "Anna",1653.34
62 |   `,
63 |     { quoteChar: "\"", sep: ",", hasHeader: false, skipRows: 1 },
64 |   )
65 |   expect(df.toRecords()).toEqual([
                              ^
error: expect(received).toEqual(expected)

  [
    {
+     column_1: "a\"",
+     column_2: null,
+   },
+   {
      column_1: "John",
      column_2: 172.23,
    },
    {
      column_1: "Anna",
      column_2: 1653.34,
    }
  ]

- Expected  - 0
+ Received  + 4

What is the actual behavior?

it seems the quote character is not respected and skipRows only looks for \n

What is the expected behavior?

the first line should be "name\na,height\nb" and the second row should start with "John"..

skipRows should respect the quoting character and skip actual rows and not lines

[Bidek56]

Using: skipRowsAfterHeader: 3 passes the test in Bun

it("repro ", () => {
    const df = pl.readCSV(
      dedent`
      "name
      a","height
      b"
      "John",172.23
      "Anna",1653.34
    `,
      { quoteChar: '"', sep: ",", hasHeader: false, skipRowsAfterHeader: 3 },
    )
    expect(df.toRecords()).toEqual([
      { "column_1": "John", "column_2": "172.23" },
      { "column_1": "Anna", "column_2": "1653.34" },
    ])
  })