Repository navigation

Multiprocess exposition speed boost - #421

Merged

brian-brazil merged 8 commits into

prometheus:masterfrom

valohai:multiproc-expose-speed

Jun 6, 2019

Merged

Multiprocess exposition speed boost#421
brian-brazil merged 8 commits into
prometheus:masterfrom
valohai:multiproc-expose-speed

Commits on Jun 4, 2019
- Split MultiProcessCollector.__init__ for better profiling
  akx
  committed
  b91aff3
- fstat mmap file only once
  akx
  committed
  b325a5e
- Avoid unpack_from() for a simple slice
  akx
  committed
  db2a7f0
Commits on Jun 6, 2019
- Avoid duplicate JSON parsing and small allocations
  akx
  committed
  9c35671
- Don't use mmap() when only reading a MmapedDict file
  akx
  committed
  fbed8d1
- Construct less tuples and dicts in accumulate
  akx
  committed
  2a56d5c
- Use less genexprs in multiprocess accumulate
  akx
  committed
  0cfb054
- Read only `used` bytes from MmapedDict files, not all the zeroes too
  akx
  committed
  0f544eb