Commit Graph

92 Commits

Author SHA1 Message Date
Lou-Kamades 44822d7495
add new bonk market 2023-12-21 16:28:12 -06:00
Lou-Kamades a0b32621a1
Merge pull request #3 from blockworks-foundation/remove-scraper
Remove scraper
2023-07-26 20:26:04 -05:00
Lou-Kamades 7bba73b7f3
refactor: make backfilling faster 2023-07-26 20:25:19 -05:00
Lou-Kamades 34dc341059
Merge branch 'main' into remove-scraper 2023-07-26 10:42:41 -05:00
Riordan Panayides cbb89a3219 Update markets 2023-06-30 19:39:14 +01:00
Riordan Panayides 252cccf74e Merge remote-tracking branch 'upstream/main' 2023-06-30 19:33:21 +01:00
Lou-Kamades 89915bf249
bugfixes and performance improvements 2023-06-15 01:50:24 -05:00
dboures c7c760ae72
Merge pull request #6 from dboures/reliable-scraping
Reliable scraping
2023-06-14 22:30:52 -05:00
Lou-Kamades f74cec5d13
refactor: remove scraper and use existing db schema 2023-06-14 02:19:27 -05:00
dboures 8b3e4b95a7
increase candle cooldown to 5 seconds 2023-06-09 07:55:41 -05:00
dboures d4afc71c04
reenable total fills metric 2023-06-08 23:50:48 -05:00
dboures c7ee74b872
style: clippy and dead code cleanup 2023-06-08 22:56:49 -05:00
dboures 4ba8fd5ec5
fix: don't mark unfetched txns as processed 2023-06-08 22:19:53 -05:00
Riordan Panayides 01b22cec38 Merge branch 'main' of github.com:blockworks-foundation/openbook-candles 2023-06-08 17:11:04 +01:00
Riordan Panayides 762cc4e770 Merge remote-tracking branch 'upstream/reliable-scraping' 2023-06-08 16:55:38 +01:00
riordanp 0d6185a58a
Add Metrics (#2)
* Add request metrics to server

* Add mango mainnet markets

* Enable fly metric polling

* Add RAY/USDC market

* Add metrics to worker, add market name to map

* Add log levels, remove unused db pings

* filter redundant 1m candles

* add debugging output to candle batching, mark old candles as completed

---------

Co-authored-by: dboures <deanboures@gmail.com>
2023-06-08 14:26:43 +01:00
Riordan Panayides a01fec5eff Merge remote-tracking branch 'upstream/main' into pan/metrics 2023-06-08 14:25:29 +01:00
Riordan Panayides 3ad2335300 Re-add candles total metric 2023-06-08 14:25:21 +01:00
dboures 67b3583ba6
refactor: worker uses a transactions table 2023-06-08 02:47:05 -05:00
dboures dc1726af43
refactor: replace id with signature in fills table 2023-06-08 01:13:41 -05:00
dboures fd4eebc034
refactor: backfilling uses a transactions table 2023-06-07 23:03:54 -05:00
dboures 83b2513164
Merge pull request #5 from dboures/remove-candles-queue
Remove candles queue + merge metrics
2023-06-07 00:20:20 -05:00
Riordan Panayides a5570b816e Merge remote-tracking branch 'upstream/remove-candles-queue' into pan/metrics 2023-06-04 11:21:38 +01:00
dboures 493ced0b00
fix: don't use serial in postgres 2023-06-03 12:22:25 -05:00
dboures e0d677c241
refactor: remove candles queue 2023-06-03 12:22:10 -05:00
dboures bf653c9672
refactor: remove sig limit and delay on scraper 2023-06-02 01:38:08 -05:00
Riordan Panayides 89e2fa7178 temp: add debugging output to candle batching, mark old candles as completed 2023-06-01 15:30:54 +01:00
dboures df461e8451
temp: filter redundant 1m candles 2023-06-01 00:58:57 -05:00
Riordan Panayides 4d81f6c7f6 Add log levels, remove unused db pings 2023-05-31 14:32:34 +01:00
Riordan Panayides 95f923f7c7 cargo fmt 2023-05-31 14:19:29 +01:00
Riordan Panayides c055d8b992 Add more worker metrics 2023-05-31 14:12:26 +01:00
Riordan Panayides 3a515d61a0 Merge remote-tracking branch 'upstream/main' into pan/metrics 2023-05-30 18:03:20 +01:00
Riordan Panayides 35937c9572 Add metrics to worker, add market name to map, cargo fmt, fix RAY/USDC id 2023-05-30 18:01:47 +01:00
Riordan Panayides 9489bd3e78 Add RAY/USDC market 2023-05-30 12:16:20 +01:00
dboures 93d95005f5
chore: remove stale sqlx file + update markets.json 2023-05-29 23:35:47 -05:00
dboures 9c7a42f83e
refactor: don't use prepared statements 2023-05-29 23:35:06 -05:00
dboures b1999c0061
fix: /tickers returns last prices if stale 2023-05-29 23:31:57 -05:00
Riordan Panayides ac2e906688 Enable fly metric polling 2023-05-29 20:48:53 +01:00
Riordan Panayides 522e7a5865 Add mango mainnet markets 2023-05-29 20:42:26 +01:00
Riordan Panayides 0591f5b3ab Add request metrics to server 2023-05-29 18:37:03 +01:00
riordanp 9b69e380c3
Remove combined deploy config (#1) 2023-05-23 12:37:58 +01:00
dboures df1af2c10d
chore: remove illiquid markets 2023-05-20 14:18:45 -05:00
dboures 34117ca95e
fix: query error in /coingecko/tickers 2023-05-20 13:59:56 -05:00
dboures 6e16ef8e04
lint: cargo clippy 2023-05-19 19:16:37 -05:00
dboures 7ae8339ebb
feat: split backfills into trades and candles 2023-05-19 19:15:13 -05:00
dboures 8bbf89677c
docs: update .env-example 2023-05-19 14:51:20 -05:00
dboures 0e821cc3c1
feat: fill events include block time (fixes backfill issues) 2023-05-19 14:50:56 -05:00
Riordan Panayides 872e6fcdb2 Fix reading postgres config from env 2023-05-18 19:41:17 +01:00
Riordan Panayides 5b61f3d949 wip: many changes for deployment
- split out postgres config and read from env
- make ssl optional
- revert to separate dockerfiles
- give tokio enough workers
- allow custom server bind address
- fix warnings
- cargo fmt
2023-05-17 17:11:17 +01:00
Riordan Panayides 697a20d9ff Fix backfill 2023-05-16 15:59:33 +01:00