Best Practices: Loading Data to DB Tables

SQream is used to store big data and is therefore designed to perform best when loading large bulks of rows (vs single inserts).
Ideally, the minimal number of rows to load in a single csv file should be 1,048,576.

Each load operation will generate a different file. SQream will then re-extent your files to produce large data files  (roughly 20-40mb) using an ongoing maintenance process constantly running in the background. 

  • SQream Ingestion rate is up to 2TB per hour (input type dependent)

You may load a single file at a time by specifying file name or a directory full of files. See Bulk Loading a CSV

  • 132
  • 15-May-2017
  • 696 Views