Hi, We are trying to import data(CSV files) using ...
# nebula
a
Hi, We are trying to import data(CSV files) using nebula importer. The speed is really slow and the CPU cores/memory is also not being utilised appropriately (mostly uses 1 core). When we add indexes to existing nodes/edges then also nebula takes a lot of time. Do we have any idea on how we could improve the import and indexing speed here? Setup is a standalone nebula server with 2 TB disk, 748GB RAM & 96 Cores.
s
Sorry for the late reply. If you are looking to import data, please check to see if the compaction parameter in the storage configuration is turned off, as performing compaction-related operations during data import can affect speed. Additionally, importing data when indexes already exist will reduce the import speed. If you're importing data without indexes and without compaction, you might try adjusting the batch size parameter in the Nebula importer, as it can affect the speed of the import.