Make ETL file size configurable (#6927)

Co-authored-by: Alexey Shekhirin <a.shekhirin@gmail.com>
Co-authored-by: joshieDo <ranriver@protonmail.com>
This commit is contained in:
Misha
2024-03-13 14:51:30 +01:00
committed by GitHub
parent c9c269b64f
commit 5d6ac4c815
14 changed files with 87 additions and 14 deletions

View File

@ -221,6 +221,19 @@ The storage history indexing stage builds an index of what blocks a particular s
commit_threshold = 100000
```
### `etl`
An ETL (extract, transform, load) data collector. Used mainly to insert data into `MDBX` in a sorted manner.
```toml
[stages.etl]
# The maximum size in bytes of data held in memory before being flushed to disk as a file.
#
# Lower threshold corresponds to more frequent flushes,
# but lowers temporary storage usage
file_size = 524_288_000 # 500 * 1024 * 1024
```
## The `[peers]` section
The peers section is used to configure how the networking component of reth establishes and maintains connections to peers.