Batch INSERT : Trying to speed things up
Posted: 02.12.2005, 15:10
Hello,
I'm using zeoslib alpha with Delphi 7 on an embedded Firebird DB doing a batch insert in a table (between 300K and 18M records).
Basically, I read from an ASCII file, convert some values, and create the SQL query to insert a new row. On average speed is about 500 records/s. I played a bit with TZConnection.StartTransaction and TZConnection.AutoCommit, but speed increase is marginal.
What is the recommended way to handle transactions in such a case (I suspect only one commit is needed, but how can I check if it's the case) ?
Thanks in advance.
I'm using zeoslib alpha with Delphi 7 on an embedded Firebird DB doing a batch insert in a table (between 300K and 18M records).
Basically, I read from an ASCII file, convert some values, and create the SQL query to insert a new row. On average speed is about 500 records/s. I played a bit with TZConnection.StartTransaction and TZConnection.AutoCommit, but speed increase is marginal.
What is the recommended way to handle transactions in such a case (I suspect only one commit is needed, but how can I check if it's the case) ?
Thanks in advance.