API for inserting multiple rows fast #2

Activity

1. horatio-sans-serif commented on Jun 2, 2011

   

   horatio-sans-serif

   on Jun 2, 2011

   More actions

   ?
2. kkaefer commented on Jun 2, 2011

   

   kkaefer

   on Jun 2, 2011

   ContributorAuthor

   More actions

   This is a feature request. The feature would provide an API for batching large amounts of rows from JS to C++ land. The idea is to improve performance. However, we haven't found any performance bottlenecks in this area for our use case, so it's not implemented yet.
3. horatio-sans-serif commented on Jun 2, 2011

   

   horatio-sans-serif

   on Jun 2, 2011

   More actions

   a-ha!
4. klaufir commented on Jan 27, 2014

   

   klaufir

   on Jan 27, 2014

   More actions

   This is a must have. Well established DB-APIs all have some way to batch insert values. See Python's executemany. http://www.python.org/dev/peps/pep-0249/#id18 .
5. springmeyer

   added a commit that references this issue on May 4, 2018

   c++11 requirement for xcode (#2)

   6021084
6. RobertSasak commented on May 29, 2019

   

   RobertSasak

   on May 29, 2019

   More actions

   I recommend adding following. It has speed up inserting in order of magnitude. Source: http://blog.quibb.org/2010/08/fast-bulk-inserts-into-sqlite/

   db.run('PRAGMA synchronous=OFF')
   db.run('PRAGMA count_changes=OFF')
   db.run('PRAGMA journal_mode=MEMORY')
   db.run('PRAGMA temp_store=MEMORY')

   👍React with 👍5Reacted by Jan Święcki, Tiago @ Siebly.io, Daniel Lockyer, Wang Guan and LJeLogbooks
7. cekvenich commented on Apr 21, 2020

   

   cekvenich

   on Apr 21, 2020

   More actions

   What RobertSasak said plus begin/commit. I get ~ 30K rows/sec.

   👍React with 👍3Reacted by Jan Święcki, Drew Loomer and Tiago @ Siebly.io
8. paulfitz

   added a commit that references this issue on Apr 29, 2021

   Fixed testing on linux, readme, electron test (TryGhost#2)

   ...

   de2475e
9. daniellockyer commented on Sep 17, 2022

   

   daniellockyer

   on Sep 17, 2022

   Contributor

   More actions

   I like the PRAGMA suggestions in this thread, so I don't think we explicitly need a specific API right now 🙂
10. daniellockyer

    closed this as not plannedon Sep 17, 2022