8f15aa311f
fix: Fix --debug-cutoff-height semantics
...
NOTE: This is a debug feature not on by default.
The original intention of it was limiting the highest block number. But it was instead enforcing the starting block number for fetching, leading to block progression.
2025-10-12 02:22:55 +00:00
4d83b687d4
feat: Add metrics for file read triggered
...
Usually, "Loading block data from ..." shouldn't be shown in logs at all. Add metrics to detect the file read.
2025-10-05 11:28:11 +00:00
12f366573e
fix: Do not increase block counter when no block is read
...
This made ingest loop to infinitely increase the block number
2025-10-05 11:28:11 +00:00
b8bae7cde9
fix: Utillize LruMap better
...
LruMap was introduced to allow getting the same block twice, so removing the item when getting the block doesn't make sense.
2025-10-05 11:28:11 +00:00
0fd4b7943f
refactor: Use offsets instead of lines, wrap related structs in one
2025-10-05 11:28:04 +00:00
bfd61094ee
chore: cargo fmt
2025-10-05 09:58:13 +00:00
de7b524f0b
fix: Fix typo in --local (default hl-node dir)
2025-10-05 04:39:09 -04:00
b55ddc54ad
chore: clippy
2025-10-05 04:04:30 -04:00
aa73fab281
chore: Now cargo fmt sorts imports and trait methods
2025-10-05 03:56:23 -04:00
875304f891
feat: Add debug CLI flag to enforce latest blocks (--debug-cutoff-height)
...
This is useful when syncing to specific testnet blocks
2025-10-02 14:53:47 +00:00
66c2ee654c
feat: Add block source metrics
2025-09-11 18:50:22 -04:00
5ee9053286
fix: Do not crash when collect_block failed
...
Just gracefully return it as error and log it
2025-08-28 13:47:44 -04:00
dd2c925af2
fix: Sort hl-node files correctly
2025-08-26 13:47:34 -04:00
52909eea3f
feat: Add --local.fallback-threshold, --s3.polling-interval
2025-08-25 22:27:26 -04:00
ad4a8cd365
remove: Remove unnecssary tests
2025-08-25 21:12:34 -04:00
65cdc27b51
fix: line_to_evm_block don't hold equivalent semantic after refactor
2025-08-24 16:46:45 +08:00
19f35a6b54
chore: clippy, fmt
2025-08-24 01:15:36 -04:00
d61020e996
refactor: Split files for block sources
...
By claude code
2025-08-24 01:14:33 -04:00
657df240f4
fix: Avoid unnecessarily exposing pseudo peer
2025-08-23 22:17:03 -04:00
73a34a4bc1
chore: clippy
2025-08-23 22:17:03 -04:00
d8eef6305b
remove: Reduce unnecessary LoC
2025-08-23 22:17:03 -04:00
bae68ef8db
refactor: Reduce unnecessary LoC
...
By claude code
2025-08-23 04:21:23 -04:00
b6d5031865
feat: Support testnet sync
...
- Add testnet S3 bucket
- Use testnet RPC properly
- Use testnet chainspec on pseudo peer
2025-08-22 10:40:36 -04:00
6543fac314
feat: Add testnet chainspec
2025-08-22 10:38:52 -04:00
4be1aa83de
Port to reth 1.6.0-dev
2025-08-21 05:58:37 -04:00
239ee5f8e8
remove: Remove logs that degrades performance
...
This happens when syncing from genesis while local-ingest-dir exists. Find better way of logging them, and before that, disable it.
2025-08-08 02:06:45 -04:00
bd9a0020e6
refactor: Code style, lint
2025-08-04 02:50:39 -04:00
a8df1fdaeb
fix: Reduce fallback request before even next block is mined
...
Currently it was doing 0.5s + (0.25s x N); now it's 5s + (0.25s x N), assuming 5 block behind is bad enough to request fallback. Also usually fallback "exists" so that it updates last poll time acordingly, so it won't poll much after fallback is triggered.
2025-08-02 23:57:51 -04:00
c27e5e5a64
fix/perf: Fix last line scanner, wait 0.5s before fallback if it's more recent, add tests
2025-08-02 17:10:30 -04:00
c0b3acf181
perf: Reduce log
2025-08-01 17:37:29 +00:00
77158aa164
perf: Do not allocate much when backfilling ranges
2025-08-01 17:30:33 +00:00
2d6b5e5cd2
chore: Improve log
2025-08-01 17:28:31 +00:00
ff2e55b5a2
perf: Do not use cutoff when backfilling
2025-08-01 17:20:09 +00:00
0180711ae4
perf: Constrain memory size again, add log
2025-07-31 01:56:39 -04:00
a766ee0236
feat: Support range-based backfill for hl-node ingestion
2025-07-31 01:51:22 -04:00
46c9d4cbf9
fix: Fix path parser
2025-07-31 01:00:28 -04:00
78ae5643b1
fix: Should use fallback when there is no hl-node files
2025-07-30 23:32:25 -04:00
4e59ee62dc
fix: Reduce fallback usage in hl-node ingestion
2025-07-30 23:29:18 -04:00
c34ee01b70
fix: Do not use LruMap
...
LruMap does not support backfill.
2025-07-30 22:20:21 -04:00
9fcc04e889
fix: Use correct cutoff block number
2025-07-30 21:27:55 -04:00
a2e978dc0c
fix typo
2025-07-30 04:37:49 +00:00
a47674ac30
feat: Add backfill support from local node
...
This currently does not support huge amount of backfill log within local node
2025-07-30 04:05:52 +00:00
450e228a8f
refactor: Move official RPC url to HlChainSpec
2025-07-05 03:17:36 +00:00
5987f147f1
feat: Add cli aliases for nanoreth compatibility, add --local
2025-07-04 18:24:27 +00:00
f6830a67cd
refactor: Use PathBuf for local block source config
2025-07-04 18:23:08 +00:00
f605c56bdf
chore: cargo fix, fmt and misc fixes
2025-07-02 16:06:32 +00:00
ff6744c6d4
fix: Fix local node source being ignored
2025-07-02 10:45:31 +00:00
d90ddbbc65
chore: more log
2025-07-02 10:45:24 +00:00
2821034f95
remove: remove unused main
2025-07-02 10:45:11 +00:00
7fb5e8dd96
refactor: Cleanup code
2025-07-01 17:33:00 +00:00
