Riordan Panayides
762cc4e770
Merge remote-tracking branch 'upstream/reliable-scraping'
2023-06-08 16:55:38 +01:00
Riordan Panayides
3ad2335300
Re-add candles total metric
2023-06-08 14:25:21 +01:00
dboures
67b3583ba6
refactor: worker uses a transactions table
2023-06-08 02:47:05 -05:00
dboures
dc1726af43
refactor: replace id with signature in fills table
2023-06-08 01:13:41 -05:00
dboures
fd4eebc034
refactor: backfilling uses a transactions table
2023-06-07 23:03:54 -05:00
Riordan Panayides
a5570b816e
Merge remote-tracking branch 'upstream/remove-candles-queue' into pan/metrics
2023-06-04 11:21:38 +01:00
dboures
493ced0b00
fix: don't use serial in postgres
2023-06-03 12:22:25 -05:00
dboures
e0d677c241
refactor: remove candles queue
2023-06-03 12:22:10 -05:00
dboures
bf653c9672
refactor: remove sig limit and delay on scraper
2023-06-02 01:38:08 -05:00
Riordan Panayides
89e2fa7178
temp: add debugging output to candle batching, mark old candles as completed
2023-06-01 15:30:54 +01:00
dboures
df461e8451
temp: filter redundant 1m candles
2023-06-01 00:58:57 -05:00
Riordan Panayides
4d81f6c7f6
Add log levels, remove unused db pings
2023-05-31 14:32:34 +01:00
Riordan Panayides
95f923f7c7
cargo fmt
2023-05-31 14:19:29 +01:00
Riordan Panayides
c055d8b992
Add more worker metrics
2023-05-31 14:12:26 +01:00
Riordan Panayides
3a515d61a0
Merge remote-tracking branch 'upstream/main' into pan/metrics
2023-05-30 18:03:20 +01:00
Riordan Panayides
35937c9572
Add metrics to worker, add market name to map, cargo fmt, fix RAY/USDC id
2023-05-30 18:01:47 +01:00
dboures
9c7a42f83e
refactor: don't use prepared statements
2023-05-29 23:35:06 -05:00
dboures
b1999c0061
fix: /tickers returns last prices if stale
2023-05-29 23:31:57 -05:00
Riordan Panayides
0591f5b3ab
Add request metrics to server
2023-05-29 18:37:03 +01:00
dboures
34117ca95e
fix: query error in /coingecko/tickers
2023-05-20 13:59:56 -05:00
dboures
6e16ef8e04
lint: cargo clippy
2023-05-19 19:16:37 -05:00
dboures
7ae8339ebb
feat: split backfills into trades and candles
2023-05-19 19:15:13 -05:00
dboures
0e821cc3c1
feat: fill events include block time (fixes backfill issues)
2023-05-19 14:50:56 -05:00
Riordan Panayides
872e6fcdb2
Fix reading postgres config from env
2023-05-18 19:41:17 +01:00
Riordan Panayides
5b61f3d949
wip: many changes for deployment
...
- split out postgres config and read from env
- make ssl optional
- revert to separate dockerfiles
- give tokio enough workers
- allow custom server bind address
- fix warnings
- cargo fmt
2023-05-17 17:11:17 +01:00
Riordan Panayides
697a20d9ff
Fix backfill
2023-05-16 15:59:33 +01:00
dboures
c20429bcc5
wip: attempt to use SSL cert
2023-05-14 03:21:34 -05:00
dboures
a4bf9a35be
refactor: server uses tokio-postgres instead of sqlx
2023-05-14 03:09:12 -05:00
dboures
cead78381d
refactor: worker uses tokio-postgres instead of sqlx
2023-05-14 02:15:10 -05:00
dboures
83e63c0de2
chore: add more markets
2023-05-10 16:33:54 -05:00
dboures
67c79a1b8f
fix: release builds
2023-05-07 23:18:01 -05:00
dboures
f431290284
feat: attempt to implement parallelized backfill
2023-05-07 22:16:29 -05:00
dboures
5da3dd3a79
refactor: remove slow rpc call from /tickers
2023-05-07 16:59:00 -05:00
dboures
037afe36dd
feat: add /orderbook route
2023-05-07 16:43:55 -05:00
dboures
be1424b1e1
feat: finish /tickers route
2023-05-06 20:06:42 -05:00
dboures
3aafa73d45
feat: add modified slab from serum
2023-05-06 20:06:19 -05:00
dboures
1a08501095
feat: add non-orderbook coingecko routes
2023-05-05 20:41:17 -05:00
dboures
f509df05d5
fix: candle batching works with 0 fills
2023-03-27 14:01:48 -05:00
dboures
bbf73b164b
fix: fix connection timeouts
2023-03-27 12:11:58 -05:00
dboures
ce4e9d1d39
fix: try to use loops to fix timeouts
2023-03-26 14:39:25 -05:00
dboures
aa114539c0
feat: add docker deployment
2023-03-14 20:46:49 -05:00
dboures
74a042df9d
refactor: rename crator folder
2023-03-14 16:57:42 -05:00
dboures
8ccfcbde04
refactor: simplify writing fills to db
2023-03-14 01:21:15 -05:00
dboures
0057a2faa2
feat: add markets endpoint
2023-03-14 00:45:29 -05:00
dboures
6daf18bbe6
remove unused backfill and websocket files
2023-03-14 00:34:23 -05:00
dboures
c5d3a1f4ab
feat: markets in batcher spawn own threads
2023-03-14 00:31:00 -05:00
dboures
4abadc9589
feat: can query traders by quote volume
2023-03-13 16:18:18 -05:00
dboures
c01e53b41c
feat: add traders base volume endpoint
2023-03-13 11:51:30 -05:00
dboures
6e8ddd1ef5
refactor: create structs folder
2023-03-13 00:03:58 -05:00
dboures
352bc32210
feat: can get candles from the server
2023-03-13 00:03:37 -05:00