138efa6cec
fixed constant
2018-05-06 22:06:19 -07:00
a68e50935e
useless timeouts i think
2018-05-06 21:48:46 -07:00
e8f5fb35ac
Multinode fixes and test
...
* Replace magic numbers for 64k event size
* Fix gossip, dont ping yourself
* Retransmit only to listening nodes
* Multinode test in stub marked unstable
2018-05-06 21:36:06 -07:00
e162f24119
Limit 256 events per entry
...
Attempt to keep blob size under 64kb
2018-05-04 11:52:05 -06:00
2d5313639a
Factor out entry processing and fix replicate test to call global setup fn
2018-05-03 22:24:30 -07:00
888c2ffb20
Fix bind so we can talk on external interfaces and surface send error
2018-05-03 17:05:02 -07:00
2cdd515b12
Compiles/fmt and add assert for forward progress
2018-05-03 14:58:08 -07:00
0aad71d46e
fix entry serialize
2018-05-03 14:35:04 -07:00
68c7f992fa
Sooth all versions of rustfmt
2018-05-03 13:56:10 -06:00
1feff408ff
Implement get_last_id() with transaction_count()
...
This is more precice than the previous implementation because it'll
drain the EntryInfo queue and return the most recent last_id instead
of the first one.
2018-05-03 13:34:57 -06:00
f752e02487
Implement GetLastId with EntryInfo subscription
2018-05-03 13:31:43 -06:00
c9c7fb0a27
Update comment
...
The last PR added a thread that logs entries without needing to
be driven by the client.
2018-05-03 13:27:37 -06:00
de680c2a8e
Remove duplicate state
2018-05-03 13:24:37 -06:00
c2e2960bf7
Add broadcast impl
2018-05-03 10:34:01 -07:00
385d2a580c
Merge pull request #168 from aeyakovenko/fix_multi_host_client_demo
...
multi host client demo
2018-05-03 10:21:41 -06:00
ae29c9b4a0
Fix nightly build
2018-05-03 09:38:59 -06:00
078f917e61
useless assert
2018-05-03 08:34:57 -07:00
b65f04d500
multi host client demo
...
Bind to the same interface as the user supplied client address.
2018-05-03 08:28:11 -07:00
4b9f115586
Hoist Historian input
2018-05-02 16:35:37 -06:00
c5cc91443e
Rename sender/receiver to input/output
2018-05-02 15:54:53 -06:00
48d94143e7
Fix CI
2018-05-02 11:05:11 -06:00
63cf6363a2
more rustfmt
2018-05-02 12:24:25 -04:00
cc6de605ac
rustfmt
2018-05-02 12:21:20 -04:00
d0151d2b79
restored original test logic
2018-05-02 12:07:42 -04:00
6b45d453b8
modified verification map
2018-05-02 10:44:41 -04:00
b992a84d67
modified verification to loop until success or failure
2018-05-02 10:15:08 -04:00
cb362e9052
rust format
2018-05-01 16:38:15 -04:00
ccb478c1f6
improved error handling and atomic transactions
2018-05-01 16:38:15 -04:00
edf6272374
Merge pull request #154 from sakridge/replicator
...
Replicator
2018-04-27 14:30:52 -06:00
7f6a4b0ce3
Deserialize the Entry structs and process them
2018-04-27 13:15:19 -07:00
3be5f25f2f
Work on test_replicate to test replicate service
...
generate some messages to send to replicator service
2018-04-27 08:21:34 -07:00
1b6cdd5637
Fix some compilation issues
2018-04-27 08:21:34 -07:00
f752e55929
update
2018-04-27 08:21:34 -07:00
ebb089b3f1
wip
2018-04-27 08:21:34 -07:00
ad6303f031
docs
2018-04-27 08:21:34 -07:00
828b9d6717
docs
2018-04-27 08:21:34 -07:00
444adcd1ca
update
2018-04-27 08:21:34 -07:00
69ac305883
wip
2018-04-27 08:21:34 -07:00
2ff57df2a0
state replication
2018-04-27 08:21:34 -07:00
7077f4cbe2
Merge pull request #128 from garious/faster-demo
...
Utilize parallelized accountant in demo
2018-04-27 08:47:42 -06:00
d90ab90145
bind to all
2018-04-26 13:54:29 -07:00
48018b3f5b
docs
2018-04-26 13:50:57 -07:00
15584e7062
recover full network from a star
2018-04-26 13:48:42 -07:00
d415b17146
sleepless demo to complement sleepless nights
...
18 ktps on macbook pro, no gpu
2018-04-26 13:17:38 -06:00
9ed953e8c3
Fix rebase fails
2018-04-26 09:35:10 -06:00
b60a98bd6e
Startup log can reference IDs without itself
2018-04-26 08:42:34 -06:00
a15e30d4b3
Report transactions processed
2018-04-26 08:42:34 -06:00
d5d133353f
Port blocking stub functions to new stateful ones
2018-04-26 08:42:34 -06:00
6badc98510
Add low-level response-handling functions to skel
2018-04-26 08:42:34 -06:00
ea8bfb46ce
Add a way to subscribe for new entry metadata
2018-04-26 08:42:34 -06:00
58860ed19f
WIP: New demo that makes better use of the parallelized accountant
2018-04-26 08:42:34 -06:00
583f652197
Generate genesis log for the demo
...
This log contains a bunch of transactions that generate new
accounts, so that transactions to and from them can be processed
in parallel.
2018-04-26 08:42:34 -06:00
38fdd17067
Add initializing log message to server
...
Handy when gesesis block is large.
2018-04-26 08:42:34 -06:00
807ccd15ba
Add solana-mint-demo CLI
...
This extends solana-mint with additional data that will be used by
both solana-client-demo and creating the demo's genesis block.
2018-04-26 08:42:34 -06:00
1c923d2f9e
Fix entry hash when no events and num_hashes is one
2018-04-26 08:42:34 -06:00
2676b21400
Merge pull request #151 from rlkelly/139__forget_signature
...
added forget_signature method
2018-04-26 08:28:11 -06:00
fd5ef94b5a
added forget signature method
2018-04-26 07:22:11 -04:00
34d1805b54
Add FutureResult to return a Future that immediately resolves
2018-04-25 19:23:24 -07:00
55b8d0db4d
cleanup
2018-04-23 23:33:21 -07:00
3d7969d8a2
initial crdt implementation
2018-04-23 23:06:28 -07:00
3da1fa4d88
improve the error messages
2018-04-21 21:52:55 +08:00
10a0c47210
Merge pull request #137 from garious/linux-hang
...
Workaround linux hang
2018-04-19 11:46:48 -06:00
8181bc591b
Add -h/--help options for client-demo and testnode
2018-04-19 10:22:31 -07:00
c6048e2bab
Workaround linux hang
...
Without this patch, Linux systems would hang when running the demo.
The root cause (why Linux is acting differently than macOS) was
not determined, but we know the problem is caused by a known
issue in the transaction pipeline - that entries are not pulled
off the historian channel until after the full transaction batch
is processed. This patch makes the sync_channel large enough that
it should never block on a gigabit network.
2018-04-19 10:04:32 -07:00
60015aee04
report serde parse errors to stderr
2018-04-19 23:51:57 +08:00
43e6741071
Merge pull request #134 from rleungx/report-parse-errors-to-stderr
...
report parse errors to stderr
2018-04-19 08:38:38 -06:00
b91f6bcbff
report parse errors to stderr
2018-04-19 22:24:46 +08:00
13a2f05776
Remove out for immutable variable
2018-04-19 23:00:16 +09:00
dea5ab2f79
Add erasure rust logic under feature flag
2018-04-18 19:42:09 -07:00
29f3230089
docs
2018-04-17 19:53:18 -07:00
d003efb522
fix docs
2018-04-17 19:52:46 -07:00
97e772e87a
docs
2018-04-17 19:46:50 -07:00
0b33615979
udpate
2018-04-17 12:48:06 -07:00
249cead13e
docs
2018-04-17 11:07:43 -07:00
7c96dea359
fmt
2018-04-17 11:05:35 -07:00
374c9921fd
comments
2018-04-17 11:05:15 -07:00
fb55ab8c33
format
2018-04-16 21:02:37 -07:00
13485074ac
test cast
2018-04-16 20:57:15 -07:00
4944c965e4
update
...
heap
update
update
wip
use a vec and sort
builds
update
tests
update
fmt
update
progress
fmt
passes needs retransmit test
tests
cleanup
update
update
update
update
fmt
2018-04-16 20:33:09 -07:00
7fc42de758
Fix bench
2018-04-13 00:36:23 -04:00
0a30bd74c1
Tell verifiers when not to parallelize accounting
...
Without this patch, many batches of transactions could be tossed
into a single entry, but the parallelized accountant can only
guarentee the transactions in the batch can be processed in
parallel.
This patch signals the historian to generate a new Entry after
each batch. Validators must maintain sequential consistency
across Entries.
2018-04-12 21:08:53 -06:00
9b12a79c8d
cargo +nightly fmt
2018-04-12 17:04:11 -06:00
8dc15b88eb
Add skel test which sends a bad transaction, verify it doesn't make it
2018-04-12 15:01:59 -07:00
c2eeeb27fd
bump timer
2018-04-12 11:12:10 -07:00
180d8b67e4
requests to packets function
2018-04-12 10:44:09 -07:00
51633f509d
Fix test
...
The test was meant to ensure the signature covered the 'tokens'
field, but then when the 'plan' field was rolled in, Transaction::verify()
started failing because Plan::verify() failed. When Transaction::verify()
was split into two, the unexpected failure was exposed but went unnoticed.
This patch brings it back to its original intent, to ensure signature
verification fails if the network attempts to change the client's payment.
2018-04-11 22:17:21 -06:00
705228ecc2
Remove redundant signs
2018-04-11 22:17:21 -06:00
3b9ef5ccab
Fix the nightly build
2018-04-11 20:24:14 -06:00
be9a670fb7
Add process_packets() benchmark
2018-04-11 18:02:45 -06:00
6e43e7a146
Enable parallelized accountant
2018-04-11 18:01:59 -06:00
ab2093926a
Merge pull request #120 from aeyakovenko/fix_bench_compile
...
fix compile error
2018-04-11 18:01:13 -06:00
2ef3db9fab
fix compile error
2018-04-11 15:40:25 -07:00
6987b6fd58
Add tests for ecdsa sig checking
2018-04-11 12:29:44 -07:00
50ccecdff5
Refactor
2018-04-11 09:02:33 -06:00
e838a8c28a
Delete unused function
2018-04-10 21:56:13 -06:00
e5f7eeedbf
Use iterators
2018-04-10 21:48:26 -06:00
d1948b5a00
Zip earlier
...
And remove redundant into_iter() calls.
2018-04-10 21:18:39 -06:00
c934a30f66
commandline options for client and testnode
2018-04-09 21:14:52 -07:00
f330739bc7
Recycler test should verifyt that its recycling
2018-04-07 07:08:42 -07:00
584c8c07b8
Better symmetry
...
deserialize -> process -> serialize
2018-04-06 16:34:59 -06:00
a93ec03d2c
Move creating blobs into its own function
2018-04-06 16:22:02 -06:00
7bd3a8e004
Reduce cyclomatic complexity
2018-04-06 16:12:13 -06:00
912a5f951e
Why is msgs cloned here?
2018-04-06 15:58:11 -06:00
6869089111
Parallelize deserialize
2018-04-06 15:52:58 -06:00
6fd32fe850
Cleanup constants
2018-04-06 15:43:05 -06:00
81e2b36d38
Cleanup packet_verify
2018-04-06 15:24:15 -06:00
7d811afab1
Parallelize CPU sig verify
2018-04-06 15:21:49 -06:00
5fc81dd6c8
Fix the nightly build
...
Nightly uses a different (but backward compatible) version of rustfmt.
2018-04-05 22:39:29 -06:00
491a530d90
Support parallelization of arbitrary transactions
...
Still assumes witnesses are processed serially afterward.
2018-04-05 22:30:25 -06:00
c12da50f9b
Fix race condition
...
Without this patch, it was possible for two transactions with the same
'from' address to drive its balance below zero. With the patch, we'll
hold a write lock from just before we verify sufficient funds until
after those funds are deducted from the account.
2018-04-05 22:30:25 -06:00
41e8500fc5
Break up process_verified_transaction()
2018-04-05 22:29:13 -06:00
f4466c8c0a
Change for cuda verify integration
2018-04-05 20:00:44 -07:00
01326936e6
Expire all transactions after some amount of time
...
Reject old transactions so that we can calculate an upper bound
for memory usage, and therefore ensure the server won't slow
down over time to crash due to memory exhaustion.
2018-04-05 10:26:45 -06:00
c960e8d351
Reject transactions with a `last_id` that isn't from this ledger
...
Before this patch, a client could put any value into `last_id` and
was primarily there to ensure the transaction had a globally unique
signature. With this patch, the server can use `last_id` as an
indicator of how long its been since the transaction was created.
The server may choose to reject sufficiently old transactions so
that it can forget about old signatures.
2018-04-05 09:54:03 -06:00
8d425e127b
Update benchmark to avoid write locks in sig duplicate detection
2018-04-04 17:29:22 -06:00
3cfb07ea38
Sort signatures by last_id
...
This will allow for additional concurrency as well as give the server
a means of garbage-collecting old signatures.
2018-04-04 17:06:31 -06:00
76679ffb92
Per-cell locking
...
This allows us to use read-locks for balances most of the time. We
only lock the full table if we need to add one.
2018-04-04 16:31:13 -06:00
dc2ec925d7
Better test
2018-04-04 16:01:43 -06:00
014bdaa355
Add benchmark for parallel transaction processing
2018-04-04 12:43:27 -06:00
0c60fdd2ce
Make accountant thread-safe
...
Before this change, parallel transaction processing required locking
the full accountant. Since we only call one method,
process_verified_transaction, the global lock equates to doing no
parallelization at all. With this change, we only lock the data that's
being written to.
2018-04-04 12:33:03 -06:00
5ac7df17f9
Implement window service
...
Batch out of order blobs until we have a contigious window.
2018-04-03 13:53:19 -07:00
c323bd3c87
Fix clippy warnings
2018-04-03 09:55:33 -06:00
2f80747dc7
Move tests
...
After we restructured for parallel verification, the tests here
were unreferenced by the accountant, but still meaningful to
transaction verification.
2018-04-02 21:45:21 -06:00
94eea3abec
fmt
2018-04-02 21:15:21 -06:00
fe32159673
Add a test to ensure witness data continues to be hashed
2018-04-02 21:07:38 -06:00
07aa2e1260
Add witness data to entry hash
...
Otherwise, witnesses can be dropped or reordered by a malicious
generator.
2018-04-02 20:47:51 -06:00
6fec8fad57
Adding from to the signature is redundant
2018-04-02 20:34:18 -06:00
49708e92d3
Use last_id instead of seed
...
It doesn't really matter, but was confusing since the seed points
to an entry before the mint's deposit.
2018-04-02 15:06:42 -06:00
daadae7987
Move replaying ledger out of accountant
2018-04-02 14:51:55 -06:00
2b788d06b7
Move the historian up to accountant_skel
2018-04-02 14:41:07 -06:00
90cd9bd533
Move balance check so that log_* methods are only used to add logging
2018-04-02 14:14:49 -06:00
d63506f98c
No longer allow deposits outside the constructor
2018-04-02 14:00:42 -06:00
17de6876bb
Add simpler accountant constructor
2018-04-02 13:51:44 -06:00
da2b4962a9
Move verify_slice() into a trait
2018-04-02 11:43:38 -06:00
3abe305a21
Move reserve_signatures into accountant
...
Reasons Transaction signatures need to be unique:
1. guard against duplicates
2. accountant uses them as IDs to link Witness signatures to transactions via the
`pending` hash map
2018-04-02 09:38:36 -06:00
46e8c09bd8
Revoke API access to first_id
2018-04-02 09:30:10 -06:00
9f256f0929
94 - snakecase mod names
2018-03-30 13:10:27 -07:00
ef169a6652
94: source doc review
2018-03-30 10:43:38 -07:00
b8cf5f9427
Fix transaction logging
2018-03-29 13:50:32 -06:00
2f1e585446
Better benchmark
...
Tolerates dropped UDP packets
2018-03-29 13:41:11 -06:00
22f5985f1b
Do request verification in parallel, and then process the verified requests
2018-03-29 13:18:08 -06:00
c59c38e50e
Refactor for batch verification
2018-03-29 13:09:21 -06:00
232e1bb8a3
Colocate packet dependencies
2018-03-29 12:55:41 -06:00
1fbb34620c
Fix compiler warning
2018-03-29 12:54:10 -06:00
55179101cd
Add more documentation
2018-03-29 12:20:54 -06:00
878ca8c5c5
Add microbenchmark for signature verification
2018-03-28 22:02:47 -06:00
4bc41d81ee
Fix compiler warning
2018-03-28 21:05:21 -06:00
0bec360a31
Revert TCP sync of ledger
...
The feature was too rushed. We technically don't need it until we
implement consensus. It'll come back another day (with many more tests!)
2018-03-28 20:16:15 -06:00
98c0a2af87
tx confirmed/sec ---> tx processed/sec
...
Before this patch, we were waiting until the full log was
sent back across the wire, parsed, and interpreted. That was giving
us a metric of "transactions confirmed per second" instead of
"transactions processed per second". Instead, we'll just send one
tiny packet back with the balance. As soon as the balance is what
we expect it to be, we end the benchmark.
2018-03-28 16:51:21 -06:00
849bced602
Fix up client demo
2018-03-28 14:40:58 -06:00
27f29019ef
Merge pull request #83 from garious/tcp-client
...
TCP subscription service
2018-03-28 13:19:38 -06:00
8642a41f2b
See if Travis will tolerate executing some of the test
2018-03-28 10:25:16 -06:00
bf902ef5bc
Ignore accountant_stub test
...
TODO: Figure out why this test fails on TravisCI
2018-03-28 10:05:00 -06:00
116166f62d
Rename project: silk -> solana
2018-03-27 16:25:12 -06:00
7c9681007c
Drop support for random access to the ledger
...
No longer store the ledger locally.
2018-03-27 14:47:03 -06:00
13206e4976
Let clients subscribe to the ledger over TCP
...
TODO: Add more tests
Fixes #27
2018-03-27 14:46:24 -06:00
ddb21d151d
Nightly rustfmt
...
Format code with the nightly version of rustfmt, which sorts imports.
2018-03-26 22:03:28 -06:00
c64a9fb456
Give Travis a little more time to start threads
2018-03-26 22:02:05 -06:00
ee19b4f86e
See if CI hangs because of wait_on_signature()
2018-03-26 21:53:30 -06:00
14239e584f
fix writer
2018-03-26 21:36:29 -06:00
c1783d77d7
fixed test
2018-03-25 16:18:27 -07:00
f089abb3c5
fix bench
2018-03-25 15:37:00 -07:00
8e551f5e32
debug trait tests
2018-03-25 08:22:04 -07:00
290960c3b5
wip
2018-03-25 08:06:33 -07:00
62af09adbe
wip
2018-03-25 08:05:03 -07:00
e39c0b34e5
update
2018-03-25 00:06:48 -07:00
8ad90807ee
responder with larger block size
2018-03-24 23:46:25 -07:00
533b3170a7
responder
2018-03-24 23:31:54 -07:00
7732f3f5fb
services
2018-03-24 18:01:54 -07:00
f52f02a434
services
2018-03-24 18:01:40 -07:00
9a437f0d38
Revive silk-testnode
2018-03-23 21:49:28 -06:00
fa44be2a9d
Ignore some clippy advice
2018-03-22 14:59:25 -06:00
117ab0c141
Clippy review
2018-03-22 14:50:24 -06:00
7488d19ae6
Clippy review
2018-03-22 14:40:28 -06:00
60524ad5f2
Clippy review
2018-03-22 14:38:06 -06:00
fad7ff8bf0
Clippy review
2018-03-22 14:31:58 -06:00
383d445ba1
Clippy review
2018-03-22 14:15:29 -06:00
803dcb0800
Mutex<bool> -> AtomicBool
2018-03-22 14:05:23 -06:00
8ea97141ea
Update the test to replicate the ledger
2018-03-21 17:15:32 -06:00
9f232bac58
Allow clients to sync the ledger
...
Fixes #4
2018-03-21 15:46:49 -06:00
8295cc11c0
Move JSON printing up the stack
2018-03-20 23:15:44 -06:00
9a7cac1e07
Use the Entry API to remove the double lookup
2018-03-20 18:07:54 -06:00
c584a25ec9
Move complete_transaction from method to function
...
So that we can hold separate mutable references to the pending queue
and the map of balances.
2018-03-20 17:47:57 -06:00
bff32bf7bc
Cleanup
2018-03-20 17:32:02 -06:00
d0e7450389
Add docs
2018-03-20 16:58:14 -06:00
4da89ac8a9
Cleanup naming
2018-03-20 16:53:41 -06:00
f7032f7d9a
Cleanup: replace bool retval with is_complete() method
2018-03-20 16:52:47 -06:00
7c7e3931a0
Better docs
2018-03-20 15:52:46 -06:00
6be3d62d89
Remove Action from spending plans
2018-03-20 15:43:07 -06:00
6f509a8a1e
Reorder
2018-03-20 15:31:28 -06:00
4379fabf16
PlanEvent -> Witness
...
The term used by the Simplicity smart contract language
2018-03-20 15:25:50 -06:00
c11a3e0fdc
Move streamer benchmark out of unit tests
2018-03-19 17:10:01 -06:00
8ee76bcea0
Fix benchmark build
2018-03-19 16:41:01 -06:00
9238ee9572
No longer rename log crate
2018-03-19 10:18:51 -06:00
64af37e0cd
logger -> recorder
...
Free up namespace for a traditional runtime logger.
2018-03-19 10:16:21 -06:00
9f9b79f30b
log -> ledger
...
Free up namespace for traditional runtime logs.
2018-03-19 10:09:19 -06:00
265f41887f
asset -> tokens
2018-03-19 10:03:41 -06:00
434f321336
Add spending plan tests
2018-03-18 21:02:28 -06:00
f4e0d1be58
Make conditions explicit in races
...
And boot recursive spending plans. That path required heap allocations.
Since we don't have a need for this generality right now, reduce the
language to the smallest one that can pass our test suite.
2018-03-17 20:43:05 -06:00
e5bae0604b
Specialize transaction assets to i64
...
Proof-of-history is generic, but now that we're using it entirely
for tokens, we can specialize the type and start doing more interesting
things than just Eq and Serialize operations.
2018-03-17 19:56:15 -06:00
e7da083c31
Move spending plans to their own crate
2018-03-17 19:56:15 -06:00
367c32dabe
Guard spending plans, not just payments
2018-03-17 19:56:15 -06:00
e8faf6d59a
trait test
2018-03-14 11:28:05 -07:00
baa4ea3cd8
wfmt
2018-03-14 11:14:40 -07:00
75ef0f0329
fix test
2018-03-14 11:02:38 -07:00
eb94613d7d
Use streaming socket interface within accountant
...
Pull messages from streamer process them and forward them to the sender.
2018-03-11 23:41:09 -05:00
67f4f4fb49
Merge pull request #64 from garious/dumb-contracts
...
Entry-level smart contracts
2018-03-11 13:23:11 -06:00
45765b625a
Don't let users accidentally burn their funds either
2018-03-11 12:04:49 -06:00
aa0a184ebe
Ensure the server isn't passed a Plan that spends more than is bonded
2018-03-11 11:53:45 -06:00
c82b520ea8
remove unecessary returns
2018-03-11 11:45:17 -05:00
9d6e5bde4a
ipv6 test with a separate flag
2018-03-11 11:22:21 -05:00
0eb3669fbf
cleanup timestamp processing
2018-03-11 00:30:01 -07:00
30449b6054
cleanup sig processing
2018-03-11 00:11:08 -07:00
f5f71a19b8
First go at smart contracts
...
Needs lots of cleanup.
2018-03-10 22:00:48 -07:00
0135971769
Fast UdpSocket reader
...
* message needs to fit into 256 bytes
* allocator to keep track of blocks of messages
* udp socket receiver server that fills up the block as fast as possible
* udp socket sender server that sends out the block as fast as possible
2018-03-10 21:09:23 -06:00
8579795c40
Ensure transactions won't get canceled after next refactor
2018-03-10 19:44:45 -07:00
9d77fd7eec
Store only spending plans, not full transactions
2018-03-10 18:35:10 -07:00
8c40d1bd72
Move spending endpoints into expressions
2018-03-10 17:41:18 -07:00
7a0bc7d888
Move smart contract fields into their own struct
2018-03-10 16:55:39 -07:00
49281b24e5
Move Tick out of Event
...
Every Entry is now a Tick and the entries contain events.
2018-03-09 17:22:17 -07:00
a8b1980de4
Restore reorder attack test
2018-03-09 17:02:17 -07:00
cc9f0788aa
Batch events
...
It's now a Tick that locks down event order. Before this change, the
event order would be locked down in the order the server sees it.
Fixes #59
Fixes #61
2018-03-09 16:16:33 -07:00
957fb0667c
Deterministic historian/accountant hashes
...
When in tick-less mode, no longer continuously hash on the
background thread. That mode is just used for testing and
genesis log generation, and those extra hashes are just noise.
Note that without the extra hashes, with lose the duration between
events. Effectively, we distinguish proof-of-order from proof-of-time.
2018-03-09 06:58:40 -07:00
8d17aed785
Process timestamps as they are added
2018-03-08 15:39:03 -07:00
ad6665c8b6
Complete timestamp and signature transactions
2018-03-08 11:06:52 -07:00
923162ae9d
WIP: process timestamps
2018-03-08 10:19:54 -07:00
dd2bd67049
Add a barebones test for transaction conditions
2018-03-08 08:58:34 -07:00
d500bbff04
Add public key to mint
...
This turns the mint into a handy way to generate public keys
without throwing the private key away.
2018-03-08 08:33:00 -07:00
e759bd1a99
Add conditions to the signature to reject duplicates
2018-03-08 08:18:34 -07:00
94daf4cea4
Add Cancel and Timestamp events
...
Fixes #31 , #34 , #39
2018-03-08 08:17:34 -07:00
2379792e0a
Add DateTime and Cancel conditions
...
Fixes #32 , #33
2018-03-08 08:17:08 -07:00
5dd567deef
Rename Genesis to Mint
...
Genesis is a story of creation. We should only use that term to
for the event log that bootstraps the system.
2018-03-07 17:08:15 -07:00
b6d8f737ca
Introducing, the mint
...
Use the mint to pair a new private key with new tokens.
2018-03-07 16:58:04 -07:00
491ba9da84
Add accessors to keypairs and signatures
2018-03-07 15:32:22 -07:00
a420a9293f
Fix demo
2018-03-07 11:37:30 -07:00
9834c251d0
Boot genesis block helper
...
Before this change, if you wanted to use a new Transaction
feature in the genesis block, you'd need to extend its
Creator object and associated methods. With yesterday's
addtions to Transcation, it's now so easy to work with
Transactions directly that we can get rid of the middleman.
Also added a KeyPair type alias, so that ring could be easily swapped
out with a competing library, if needed.
2018-03-07 11:10:15 -07:00
54340ed4c6
Delete debugging println
...
Thanks @jackson-sandland!
2018-03-06 21:17:41 -07:00
d1b6206858
Monomorphisize Entry and Event
...
Transaction turned out to be the only struct worth making generic.
2018-03-06 20:29:18 -07:00
b725fdb093
Sha256Hash -> Hash
...
Because in Loom, there's just the one. Hopefully no worries that it
shares a name with std::Hash.
2018-03-06 17:40:01 -07:00
1436bb1ff2
Move entry into its own module
...
Hmm, Logger doesn't depend on log.
2018-03-06 17:40:01 -07:00
5a44c36b1f
Move hash into its own module
2018-03-06 17:40:01 -07:00
f09952f3d7
DRY up transaction signing
...
Cleanup the big mess I copy-pasted myself into.
2018-03-06 16:34:25 -07:00
4376032e3a
data -> asset
...
'data' is too vague.
2018-03-06 14:50:32 -07:00
624c151ca2
Add signature module
...
Because things other than transactions can be signed.
2018-03-06 12:48:28 -07:00
5d0356f74b
Move verify_entry to a method as well
2018-03-06 12:35:12 -07:00
b019416518
Move verify into methods
...
A little overly-coupled to Serialize, but makes the code a lot tighter
2018-03-06 12:27:08 -07:00
4fcd9e3bd6
Give Transaction its own module
2018-03-06 12:18:17 -07:00
66bf889c39
Rename Transfer to Transaction
...
struct names should be nouns
2018-03-06 11:54:47 -07:00
a2811842c8
More cleanup
...
Far fewer branches when we process transfers outside the context
of events.
2018-03-06 11:43:55 -07:00
1929601425
Cleanup
...
Now that Transfer is out of the enum, we don't need to pattern
match to access its fields.
2018-03-06 11:19:59 -07:00
282afee47e
Use Transfer struct on the client side too
...
Sharing is caring.
2018-03-06 11:03:43 -07:00
e701ccc949
Rename Request::Transfer to Request::Transaction
2018-03-06 10:59:47 -07:00
6543497c17
Move Transaction data into its own struct
...
This will allow us to add addition transfer types to the log.
2018-03-06 10:50:32 -07:00
720c54a5bb
Allow balances to be negative
...
* Will allow owners to loan token to others.
* Will allow for parallel verification of balances without spilling
over 64 bits.
Fixes #43
2018-03-05 17:30:53 -07:00
a4336a39d6
Initialize the testnode from a log
...
$ cargo run --bin silk-genesis-file-demo > demo-genesis.json
$ cat demo-genesis.json | cargo run --bin silk-genesis-block > demo-genesis.log
$ cat demo-genesis.log | cargo run --bin silk-testnode
2018-03-05 15:34:44 -07:00
298989c4b9
Generate log from Genesis
2018-03-05 13:03:56 -07:00
48c28c2267
Transactions now require a hash of the last entry they've seen
...
This ensures the transaction cannot be processed on a chain
that forked before that ID. It will also provide a basis for
expiration constraints. A client may want their transaction
to expire, and the generators may want to reject transactions
that have been floating in the ether for years.
2018-03-05 12:48:14 -07:00
d76ecbc9c9
Don't block the server
2018-03-05 11:39:59 -07:00
79fb9c00aa
Boot wait_on_signature() from accountant
...
Instead, there should be a way to query for a page of log data,
and checking whether it has a signature should be done client-side.
2018-03-05 10:45:18 -07:00
c9e03f37ce
Logger now only speaks when spoken to
...
Before this change, the logger's send channel could quickly be
flooded with Tick events. Those events should only be passed to
a writer.
Also, the log_event() function no longer sends entries. That
functionality moved to the new process_events() function. This
will allow us to initialize the with the genesis block without
flooding the send channel with events the historian won't read.
2018-03-05 10:33:12 -07:00
aa5f1699a7
Update the set of unique signatures when loading an existing log.
2018-03-04 22:31:12 -07:00
955f76baab
Finally, genesis block generation without channels
2018-03-04 14:32:30 -07:00
ff82fbf112
Make num_hashes mean the num_hashes since the last ID
...
Before this change, num_hashes meant the number of hashes since
the last ID, minus any hashing done on the event data. It made
no difference for Tick events, but logged Transaction events with
one less hash than actually occurred.
2018-03-04 09:52:36 -07:00
8503a0a58f
Refactor
2018-03-04 09:21:45 -07:00
b1e9512f44
Rename end_hash to id
2018-03-04 07:50:26 -07:00
608def9c78
Consolidate imports
2018-03-04 07:28:51 -07:00
bcb21bc1d8
Delete dead code
2018-03-04 07:20:17 -07:00
9b26892bae
Add a demo app to generate the genesis file
2018-03-04 01:21:40 -07:00
572475ce14
Load the genesis block
2018-03-04 00:15:17 -07:00
876d7995e1
Refactor to support loading an existing ledger
2018-03-03 22:25:40 -07:00
b8655e30d4
Make client-demo standalone
...
And remove deposit() methods from the API. Those should only be
used on the server to bootstrap.
2018-03-03 21:15:51 -07:00
7cf0d55546
Remove optional 'from' field
2018-03-03 20:41:07 -07:00
ce60b960c0
Special case sending money to self
...
In the genesis block, let matching 'from' and 'to' keys be used
to mint new coin.
2018-03-03 20:27:12 -07:00
cebcb5b92d
Start genesis with a Tick, so that its hash can be used to bootstrap verification
2018-03-03 19:57:22 -07:00
11a0f96f5e
Add command-line tool for generating a genesis block
2018-03-03 17:35:05 -07:00
f7496ea6d1
Make create_logger a static method
...
Allows us to share the super long type signature in impl.
2018-03-03 14:26:59 -07:00
bebba7dc1f
Give logger its own crate
2018-03-03 14:24:32 -07:00
afb2bf442c
Use Instant instead of SystemTime for more precise ticking
...
And convert log_event from function to method
2018-03-03 14:08:53 -07:00
c7de48c982
Convert log_events from function to method
2018-03-03 14:00:37 -07:00
f906112c03
Move logging thread's state into a struct
2018-03-03 13:52:57 -07:00
1c9b5ab53c
Report performance of signature verification too
2018-03-03 11:59:34 -07:00
c10faae3b5
More readable metrics
2018-03-03 11:52:50 -07:00
2104dd5a0a
Fix benchmark
...
Was measuring the creation of the iterator, not running it.
2018-03-03 11:45:23 -07:00
d8c50b150c
Move key generation and signing from transaction benchmark
...
Key generation, signing and verification are not the performance
bottleneck. Something is probably wrong here.
2018-03-03 11:11:46 -07:00
a148454376
Update readme
2018-03-02 12:07:05 -07:00
be518b569b
Remove cyclic dependency between event and log
2018-03-02 12:03:59 -07:00
c998fbe2ae
Sign the owner's public key
...
Without this, the accountant will reject transfers from different
entities if they are for the same amount and to the same entity.
2018-03-02 11:56:42 -07:00
9f12cd0c09
Purge the Claim event type
...
It's now represented as a Transaction from an unknown party.
2018-03-02 11:48:58 -07:00
0d0fee1ca1
Sign Claim's 'to' field
...
Otherwise, the accountant will treat deposits of the same amount as
duplicates.
2018-03-02 11:46:22 -07:00
a0410c4677
Pipe all Claim constructors through a function
2018-03-02 10:58:43 -07:00
8fe464cfa3
Rename Claim's key field to match same field in Transaction
2018-03-02 10:47:21 -07:00
3e2d6d9e8b
Generalize Transaction to express a Claim
...
If a Transaction doesn't have an existing address, it's being used
to create new funds.
2018-03-02 10:41:15 -07:00
32d677787b
Reduce transactions sent by demo
...
We don't do retries yet, so keep tx count to something that won't
trigger any packet loss.
2018-03-02 10:35:38 -07:00
dfd1c4eab3
Don't process transaction if channel.send() fails.
...
Do all input validation first, then log (which can fail). If all
goes swimmingly, process the transaction.
2018-03-02 10:17:52 -07:00
36bb1f989d
More defense against a double-spend attack
...
Before this change, a client could spend funds before the accountant
processed a previous spend. With this change in place, the accountant
updates balances immediately, but that comes at an architectural cost.
The accountant now verifies signatures on behalf of the historian, so
that it can ensure logging will not fail.
2018-03-02 09:55:44 -07:00
684f4c59e0
Delete commented out code
...
accountant crate shouldn't verify the log. Instead, it should
only add valid entries and leave verification to network nodes.
2018-03-02 08:51:29 -07:00
1b77e8a69a
Move Event into its own crate
...
The log crate was starting to be the catch-all for all things
related to entries, events, signatures, and hashes. This split
shows us that:
* Event depends only on signatures, not on hashes [directly]
* All event testing was done via log testing (shame on me)
* Accounting depends only on events
2018-03-02 08:43:57 -07:00
c935fdb12f
Move signature duplicate detection into the historian
2018-03-01 17:44:10 -07:00
9e16937914
Delete the Discovery event
...
Not useful to the accountant.
2018-03-01 17:02:41 -07:00
f705202381
No need to hash data that's already hashed to create the signature
2018-03-01 16:39:09 -07:00
570e71f050
Check for duplicate signatures
...
TODO: have client add recent hash to each message
2018-03-01 14:07:39 -07:00
c9cc4b4369
Switch to UDP from TCP
...
And remove all the sleep()'ing around.
2018-03-01 13:47:53 -07:00
4610de8fdd
Switch to sync_channel to preserve order
2018-02-28 19:33:28 -07:00
3fcc2dd944
Add testnode
...
Fixes #20
2018-02-28 18:05:20 -07:00
8299bae2d4
Add accountant stub
2018-02-28 16:01:12 -07:00
604ccf7552
Add network interface for accountant
2018-02-28 14:00:04 -07:00
c3bb207488
Verify event signatures before adding log entries
2018-02-28 10:23:01 -07:00
fa4d9e8bcb
Add more tests
2018-02-27 11:28:10 -07:00
34b77efc87
Sleep longer for TravisCI
2018-02-27 11:08:28 -07:00
5ca0ccbcd2
Add accountant
2018-02-27 10:54:06 -07:00
f98e9a2ad7
Fix overuse of search-and-replace
2018-02-26 17:03:50 -07:00
c6134cc25b
Allow the historian to track ownership of any type of data
2018-02-26 17:01:22 -07:00
0443b39264
Allow event log to hold events of any serializable (hashable) type
2018-02-26 16:42:31 -07:00
8b0b8efbcb
Allow Entry to hold events of any kind of data
2018-02-26 15:37:33 -07:00
97449cee43
Allow events to hold any kind of data
2018-02-26 15:31:01 -07:00
ab5252c750
Move entry verification out of Entry impl
2018-02-26 14:39:01 -07:00
b02eab57d2
Extend the event log with a Transaction event to transfer possession
...
This implementation assumes 'from' is the current owner of 'data'.
Once that's verified, the signature ensures that nobody modified
'data' (the asset being transferred) or 'to' the entity taking
ownership.
Fixes #14
2018-02-26 11:09:11 -07:00
b8d52cc3e4
Make the Discovery event into a struct instead of a tuple
2018-02-24 11:15:03 -07:00
d78082f5e4
Test bad signature
2018-02-24 10:27:51 -07:00
08e501e57b
Extend the event log with a Claim event to claim possession
...
Unlike a Discovery event, a Claim event associates a public key
with a hash. It's intended to to be used to claim ownership of
some hashable data. For example, a graphic designer could claim
copyright by hashing some image they created, signing it with
their private key, and publishing the hash-signature pair via
the historian. If someone else tries to claim it as their own,
the designer can point to the historian's log as cryptographically
secure evidence that the designer's copy existed before anyone
else's.
Note there's nothing here that verifies the first claim is the actual
content owner, only that the first claim almost certainly happened
before a second.
2018-02-24 10:09:49 -07:00
29a607427d
Rename UserDataKey to Discovery
...
From the perspective of the log, when some data's hash is added,
that data is "discovered" by the historian. Another event
might be a "claim" that some signed data belongs to the owner of a
public key.
2018-02-24 05:25:19 -07:00
c1326ac3d5
Up the time to sleep so that ticks are generated
2018-02-21 12:22:23 -07:00
7871b38c80
Update demo to use self-ticking logger
2018-02-21 11:52:03 -07:00
b34d2d7dee
Allow the logger to inject Tick events on its own
2018-02-21 11:33:42 -07:00
fa4e232d73
Add serialization/deseriation support to event log
...
See bincode and serde_json for usage:
https://github.com/TyOverby/bincode
Fixes #1
2018-02-20 16:26:13 -07:00
6e37f70d55
Test reorder attack
2018-02-20 14:46:36 -07:00
d97112d7f0
Explain proof-of-history in the readme
...
Also:
* Hash userdata so that verification works as the readme describes.
* Drop itertools package. Found a way to use std::iter instead.
Fixes #8
2018-02-20 14:04:49 -07:00
ba90e43f72
Update benchmark
...
* Add asm, though it doesn't make it faster. TODO: use avx instructions.
* Do 10x less hashes, since sha256 is more expensive.
2018-02-19 16:51:35 -07:00
0297edaf1f
Use sha256 hashes instead of Rust's builtin hasher.
...
Causes a 20x performance degradation. Enabling asm did not
speed things up.
2018-02-19 16:23:53 -07:00
bb22522e45
Remove assertions that fail in the kcov docker container
2018-02-19 12:54:01 -07:00
bd3fe5fac9
Sleep a little longer to ensure Travis context switches
2018-02-19 12:33:33 -07:00
10a70a238b
Cleanup demo
2018-02-19 12:25:57 -07:00
4a7156de43
Move hash generation into stateless function
2018-02-19 12:09:58 -07:00
d88d1b2a09
Reset historian's hasher between events
...
Hasher will generate different hashes for the same input if it
had already generated a hash.
Also add a binary to ensure the example in the README works.
2018-02-19 12:03:06 -07:00
5e3c7816bd
Ensure verify_slice succeeds
2018-02-19 09:09:24 -07:00
ceb65c2669
Better function names
2018-02-18 10:05:54 -07:00
fd209ef1a9
Rename event crate to log
2018-02-18 09:59:33 -07:00
471f036444
Better names
...
Event -> Entry
EventData -> Event
2018-02-18 09:53:40 -07:00
4c94754661
More coverage
2018-02-17 21:13:52 -07:00
831e2cbdc9
Add historian
...
A microservice that continuously generates hashes, only stopping to
tag messages with the latest hash.
Fixes #8
2018-02-17 20:58:23 -07:00
69f70cfe72
Add separate benchmarks for seq and par versions of verify_slice
2018-02-16 09:38:12 -08:00
1c2e0af69b
Docs cleanup
2018-02-16 09:56:10 -07:00
a857ae514b
Test sequential version of verify_slice with same tests
2018-02-16 09:14:42 -07:00
09ccc1ee6d
Use create_ticks() outside of benchmark for improved code coverage
2018-02-16 09:06:25 -07:00
38485b09c7
Move tests to expose them to rustfmt and kcov
2018-02-15 17:47:54 -07:00
fb168fcee0
Cleanup
...
Make it so the parallel and sequential verification implementations
are only different in one line.
For reasons I don't understand Rayon's `all()` isn't `mut`.
2018-02-15 16:00:53 -07:00
b5645bc776
Rename project
2018-02-15 13:59:33 -07:00
3cef50056b
Consistent naming
2018-02-15 11:50:48 -07:00
a20e114a80
Cleanup tests
2018-02-15 11:48:18 -07:00
0dc0ae506d
Better names
2018-02-15 11:45:04 -07:00
9723c827f5
mut hash -> end_hash
2018-02-15 11:29:09 -07:00
75d091bd3c
More descriptive event data
2018-02-15 10:57:32 -07:00
d21ad9357c
More descriptive field names
2018-02-15 10:48:30 -07:00
a74540470a
Rename Tick to Event
...
* Define a tick to be an event with no user data.
* Use the term "event log" for now.
** Reserve the word "entry" for hash entries, and "item" for array items.
** Reserve the word "blockchain" for when the event is a block of something.
** Reserve the word "ledger" for when the event is of a particular type,
such as transactions.
2018-02-15 10:13:59 -07:00
beb4a643ad
Add back a more traditional version of new()
2018-02-14 16:52:09 -07:00
cdf3cffcae
Rename Tick::new() to Tick::run()
2018-02-14 16:45:42 -07:00
8a521ba163
Make space for user data
2018-02-14 16:18:06 -07:00
31d79727b6
Parallelize verification
2018-02-14 15:23:13 -07:00
8ff8e90c5e
Cleanup slice verification
2018-02-14 13:02:39 -07:00
d23fda1936
First go at Proof of History
2018-02-14 11:00:01 -07:00
bad95b7712
cargo init
2018-02-14 07:23:59 -07:00
Anatoly Yakovenko
Stephen Akridge
Greg Fitzgerald
Robert Kelly
rleungx
kwangin
Jackson Sandland