A Filecoin Network sidecar for miners to bid in storage deal auctions.

Related tags

Network bidbot
Overview

bidbot

Bidbot is a Filecoin Network sidecar for miners to bid in storage deal auctions.

Made by Textile Chat on Slack standard-readme compliant

Join us on our public Slack channel for news, discussions, and status updates. Check out our blog for the latest posts and announcements.

Table of Contents

Installation

git clone https://github.com/textileio/bidbot.git
cd bidbot
make install

What is the Storage Broker?

First, we must understand that bidbot is a piece that's part of a bigger picture: the storage broker. The storage broker (SB) is a system that receives data from multiple clients, aggregates them, and makes it available for miners to store. The SB has several unique properties that make it different than your typical Filecoin client.

  1. Miners connect to the SB to discover available data payloads awaiting deals.
  2. Miners bid on deals in real time to offer the best storage solution for each payload.
  3. All deals are offline deals, not online deals. Miners download the data to create the deal.

Currently the storage-broker is creating a slow stream of auctions, so you might see nothing happening when running bidbot. This is expected for some time, so unless you see errors in your logs you can leave the daemon running.

How it works

Whenever the SB has aggregates a minimum threshold of data, it attempts to make deals with miners. Data payloads awaiting storage is described by the usual attributes you're familiar with in Filecoin:

  • PayloadCid (cid)
  • PieceCid (cid)
  • DealSize (int64 in bytes)
  • VerifiedDeal (bool)

To initiate the storage of the new payload, the SB creates an auction. The auction is published to all connected miners to notify them that a new payload is awaiting storage on Filecoin.

To understand better what this is about, consider the following chat:

  • [Storage Broker]: "Hey miners, there's a new Auction for a dataset with size X, PayloadCid X, PieceCid X, and PieceSize X. This data will be created with a verified deal. Who's interested?"
  • [Miner-A]: "Me! Here's my Bid: price-per-epoch=0.0001FIL and I promise to accept a deal proposal with DealStartEpoch=XXXX".
  • [Miner-B]: Hey, me too! My price is 0.00000001FIL, and I promise to accept a deal proposal with DealStartepoch=YYYYY".
  • [Miner-C]: Uhm, I'm too busy now... I won't bid here and just let this pass. Maybe in the next auction!

Miners will send bids to show their interest in participating in the auction. Bids provide the SB multiple pieces of information (i.e. price, start epoch, etc) about the miner's storage intent. Unlike the chat based auction, miners connected to the SB can configure bidding to happen automatically as fast as the miner's infrastructure can handle.

The SB collects all bids from connected miners and chooses one or multiple winners. The winning algorithm is still under development, but you can expect that the following facts will help winning an auction:

  • Provide a low price per epoch.
  • Provide a low DealStartEpoch.
  • Maintain a high deal success from past auctions.

If you win an auction, you will be notified about it! If that weren't the case, you will see the declared winner published on the auction feed and most probably you'll have better luck in the next auction!

The SB relies on offline deals to make deals with miners. After you win an auction, you will pull the deal data from the SB's IPFS nodes. You can think of this flow as an automatic offline deal setup where instead of receiving hard drives, you'll pull the data from someplace and then receive the offline-deal proposal.

How do I connect with the system?

The hypothetical scenario in the previous section obviously didn't explain how you would really send bids or interact with the SB. The following diagram will help to get a better picture:

https://user-images.githubusercontent.com/6136245/124800912-97025680-df2c-11eb-9052-350adbad0d51.png

To connect to the system, you will install bidbot, a daemon that you run on your infrastructure.

The bidbot talks to the SB through libp2p pubsub topics. This is the same technology used by many libp2p applications such as lotus. Through these topics, your bidbot daemon will receive new auctions and can send bids to participate.

Whenever you win an auction, your lotus-miner will receive the deal proposal for the corresponding data so you can accept it, and a ProposalCid is generated. After acceptance, your bidbot will automatically download the PayloadCid data from the SB's IPFS nodes, and import it as you generally do with offline deals, simulating the following commands you might be aware of: lotus-miner storage-deals import-data <dealCid> <carFilePath>

The carFilePath is the CAR file that bidbot generated after downloading the deals data from the SB. The dealCid is the ProposalCid of the proposal you previously accepted from the SB.

There's nothing more to do than the usual flow of deal execution steps from that moment forward. What's important is that the deal becomes active on-chain before the StartDealEpoch you promised in your bid!

How do I run bidbot?

Here're the steps to do it:

  1. Install Go 1.15 or newer
  2. Make sure $GOPATH/bin is in your $PATH, i.e., export PATH=$GOPATH/bin:$PATH.
  3. bidbot init.
  4. The output will ask you to sign a token with the owner address of your miner.
  5. Configure your ask price, other bid settings, and auction filters. See bidbot help daemon for details. You can edit the configuration file generated by bidbot init (~/.bidbot/config) or use the equivalent flag for any given option.
  6. Use the signature you generated above to start the daemon as indicated by step 2. output.
  7. Good luck! Your bidbot will automatically bid in open deal auctions. If it wins an auction, the broker will automatically start making a deal with the Lotus miner address used in step 4.

Important configuration considerations for step 5.:

  • Bidbot will store the downloaded CAR files in ~/.bidbot/deal_data by default. This directory should be accessible by your Lotus daemon for the CAR import step to work correctly.
  • You should set correctly your --deal-start-epoch value to match your miner node configuration. If this value is incorrectly set, your miner node will reject proposals because the DealStartEpoch attribute is too soon for you to accept.
  • The --lotus-miner-api-token should have write access.

Important: The default download folder would probably work if you run bidbot in the same host as your Lotus node. If you want to run bidbot and the Lotus node in separate hosts, you should set up a shared volume and change the BIDBOT_DEAL_DATA_DIRECTORY environment variable to change the download folder target.

How does this fit in my current miner infrastructure?

The following diagram shows how bidbot, SB, and your lotus-miner interact:

https://user-images.githubusercontent.com/6136245/124801028-bb5e3300-df2c-11eb-8547-af5d72e55993.png

Note: you can install bidbot on the same host as your miner daemon, but there's a reasonable chance that you might want to avoid that for security reasons.

OK, I've it running, what I should see?

First, congratulation on being connected! When starting your bidbot daemon, you should see the following lines appearing in your console:

2021-05-28T17:33:30.814-0300    INFO    mpeer   marketpeer/marketpeer.go:148    marketpeer 12D3KooWPX8uutGrghEYLt1i9EPmLmwSUYtYD3BN1tvARK5YXDXV is online
2021-05-28T17:33:30.814-0300    DEBUG   mpeer   marketpeer/marketpeer.go:149    marketpeer addresses: [/ip4/192.168.1.27/udp/4002/quic /ip4/127.0.0.1/udp/4002/quic /ip4/192.168.1.27/tcp/4002 /ip4/127.0.0.1/tcp/4002]
2021-05-28T17:33:30.814-0300    INFO    mpeer   marketpeer/marketpeer.go:164    mdns was enabled (interval=1s)
2021-05-28T17:33:30.814-0300    INFO    bidbot/service  service/service.go:143  service started
2021-05-28T17:33:31.875-0300    INFO    mpeer   marketpeer/marketpeer.go:184    peer was bootstapped
2021-05-28T17:33:31.876-0300    INFO    bidbot/service  service/service.go:191  subscribed to the deal auction feed

It's important to check that you see the last line ("subscribed to the deal auction feed") in your log output. This means you're connected to the SB successfully.

After some time, you'll see some activity in the log output, such as:

2021-05-28T17:34:26.467-0300    DEBUG   bidbot/service  service/service.go:202  /textile/auction/0.0.1 received auction from 12D3KooWRhbmhcWGB84qPehvZvtVyzW8qNkdbcX2gGidhAmJBzhi                                                                                                         
2021-05-28T17:34:26.467-0300    DEBUG   mpeer/pubsub    pubsub/pubsub.go:245    /textile/auction/0.0.1/12D3KooWRhbmhcWGB84qPehvZvtVyzW8qNkdbcX2gGidhAmJBzhi/acks ack peer event: 12D3KooWRhbmhcWGB84qPehvZvtVyzW8qNkdbcX2gGidhAmJBzhi JOINED                                              
2021-05-28T17:34:26.467-0300    INFO    bidbot/service  service/service.go:215  received auction 01f6taxy1v33a8pmdttas03de3 from 12D3KooWRhbmhcWGB84qPehvZvtVyzW8qNkdbcX2gGidhAmJBzhi:                                                                                                    
{                                                                                                                                                                                                                                                                                         
  "id": "01f6taxy1v33a8pmdttas03de3",                                                                                                                                                                                                                                                     
  "deal_size": 524288,                                                                                                                                                                                                                                                                    
  "deal_duration": 1051200,                                                                                                                                                                                                                                                               
  "ends_at": {                                                                                                                                                                                                                                                                            
    "seconds": 1622234076,                                                                                                                                                                                                                                                                
    "nanos": 311991847                                                                                                                                                                                                                                                                    
  }                                                                                                                                                                                                                                                                                       
}

There you can see that your bidbot was notified of a new auction 🎉

You'll also see bids that are proposed in the auction:

2021-05-28T17:53:03.925-0300    INFO    bidbot/service  service/service.go:269  bidding in auction 01f6tc0ygw6bpyj00e0k17secb from 12D3KooWRhbmhcWGB84qPehvZvtVyzW8qNkdbcX2gGidhAmJBzhi: 
{                                                                     
  "auction_id": "01f6tc0ygw6bpyj00e0k17secb",                                                                                                
  "miner_addr": "f02222",                                             
  "wallet_addr_sig": "AbkFFEcauFXGH5Ob3gF4TTy9/e+kNX6midH2tl2SKtdgAFb5Qxy6+Gj38bUcRhQAy/bVjmoDC1oBvi1GbbjaGvgB",                                                                                                                                                                          
  "ask_price": 10,                                                    
  "verified_ask_price": 10,                                           
  "start_epoch": 800506,                                              
  "fast_retrieval": true                                              
}

If you win an auction, you should see a log line similar to:

2021-05-28T17:53:13.790-0300    DEBUG   bidbot/service  service/service.go:225  /textile/auction/0.0.1/12D3KooWPX8uutGrghEYLt1i9EPmLmwSUYtYD3BN1tvARK5YXDXV/wins received win from 12D3KooWRhbmhcWGB84qPehvZvtVyzW8qNkdbcX2gGidhAmJBzhi

Useful bidbot operational commands

If you have bidbot daemon running, we recommend you explore the following available commands:

  • bidbot download <data-uri>: This command allows you to download a CAR file to the bidbot download folder. This can be helpful to test downloads or manually re-download a particular CAR from a won auction (if that's necessary).
  • bidbot deals list: This command shows you a list of your won auctions and some summary of which stage you're in the process.
  • bidbot deals show <auction-id>: This command shows detailed information about a won auction.

Do you think bidbot can have other commands that would make your life easier? We're interested in knowing about that!

Contributing

Pull requests and bug reports are very welcome ❤️

This repository falls under the Textile Code of Conduct.

Feel free to get in touch by:

Changelog

A changelog is published along with each release.

License

MIT

Comments
  • Clarify permission of api-token

    Clarify permission of api-token

    In the CLI, maybe clarify what kind of permission the --lotus-miner-api-token string Lotus miner API authorization token token needs. If it's read, write, sign or admin :smiley:

    opened by rjan90 12
  • CIDGRAVITY API ERROR

    CIDGRAVITY API ERROR

    BIDBOT have error with CID GRAVITY for the last 24-48 Hours. "ERROR bidbot/pricing pricing/cid_gravity.go:157 loading rules from API: unmarshalling rules: json: cannot unmarshal string into Go struct field .PricingRules.Verified of type bool" seems like BIDBOT can't parse API response. Create ticket here and for CID Gravity. can work bidbot with this error or all bids will be rejected?

    opened by Araquiel 3
  • deal_data folder symlink gets removed

    deal_data folder symlink gets removed

    I'm not sure how to debug this, but at one point my ~/.bidbot/deal_data symlink got removed and it turned back into a regular folder.. Trying to reproduce it now.

    opened by RobQuistNL 3
  • check for running-bytes-limit only after winning an auction

    check for running-bytes-limit only after winning an auction

    and responds error deliberately if the limit is hit.

    This is yet another temporary fix. When participating in an auction, bidbot won't know if it will win or not, so it has to request for running bytes quota. But there is no way to know if it loses an auction to return the quota, so it has to wait for certain time (hardcoded 10 minutes for now) at which period it may miss many auctions.

    With this change, the limit is checked only after winning an auction, with the downside that auctioneer would say many errors, which is undesired.

    Two options I can think of:

    1. Add a protobuf field for active rejection;
    2. have auctioneer broadcasting the winners so bidbot can reset the quota ASAP.
    opened by merlinran 3
  • [Feature Request] Ability to stop the deamon via CLI

    [Feature Request] Ability to stop the deamon via CLI

    Since I'm running bidbot daemon with nohup, having the ability to gently stop the daemon with a command like bidbot daemon stop, would be quite nice :smile:

    opened by rjan90 3
  • store: allow boosted downloads

    store: allow boosted downloads

    Includes an experimental flag --boost-download which opens multiple TCP connections in content-range compatible HTTP endpoints. If the endpoint isn't compatible, it will fall back to doing usual downloads.

    Leaving this as a PR until I've some feedback from a storage provider doing some tests and confirming.

    opened by jsign 2
  • gc: take care of symlinks appropriately

    gc: take care of symlinks appropriately

    Symlinks not being handled correctly was creating an unfortunate situation:

    1. The rule to ignore "directory" inodes in the filepath walk was not detecting that deal_data was a symlink, so it was removing the symlink all over. This means that for storage providers that were using symlinks, the symlink would magically disappear
    2. filepath.Walk doesn't follow symlinks. So if deal_data is a symlink to another folder, walking the folder results in 0 files, thus directly no GC was being done.

    This fix is only relevant for storage providers that have symlink in deal_data.

    Closes https://github.com/textileio/bidbot/issues/69 Closes https://github.com/textileio/bidbot/issues/70

    opened by jsign 2
  • bidbot doing nothing, files stalled

    bidbot doing nothing, files stalled

    I just restarted bidbot again, and the logs show nothing special;

    cat /var/log/lotus/bidbot.log
    {"severity":"info","ts":"2021-11-03T20:02:34.454Z","logger":"bidbot","caller":"bidbot/main.go:319","msg":"bidbot \tversion:\tgit\n\tbuild date:\t2021-10-30T12:35:11Z\n\tgit summary:\tv0.1.5\n\tgit branch:\tmain\n\tgit commit:\t2b4218e\n\tgit state:\tclean"}
    {"severity":"info","ts":"2021-11-03T20:02:34.454Z","logger":"bidbot","caller":"bidbot/main.go:341","msg":"loaded config from /home/master/.bidbot/config: {\"announce-multiaddr\":[],\"ask-price\":4e-9,\"bootstrap-multiaddr\":[\"/ip4/34.83.3.108/tcp/4001/p2p/12D3KooWGDBaVz45c5d9VEtF4eM7Pgj71DSzB3HHAfpjc8fb5EGe\",\"/ip4/34.83.3.108/udp/4001/quic/p2p/12D3KooWGDBaVz45c5d9VEtF4eM7Pgj71DSzB3HHAfpjc8fb5EGe\",\"/ip4/34.105.101.67/tcp/4001/p2p/12D3KooW9wsxrkCx6CnsWb1gBxZWAjzVK5Hif9FLXKoQZYLewXoD\",\"/ip4/34.105.101.67/udp/4001/quic/p2p/12D3KooW9wsxrkCx6CnsWb1gBxZWAjzVK5Hif9FLXKoQZYLewXoD\",\"/ip4/34.83.36.118/tcp/4001/p2p/12D3KooWQSf4SMyWPSqLN23KxhcLWYhshWb34pYv65cr85jGpNrR\",\"/ip4/34.82.221.249/tcp/4001/p2p/12D3KooWBGyJbDmjjvEzfsgb3nE9JsfcYRqPxpnQagxbb1PyxBrb\",\"/ip4/34.83.88.62/tcp/4001/p2p/12D3KooWHpxr8BTd3R6kAqvtfn77PKW7WRqJ4cbnrT59K2rU44WM\"],\"cid-gravity-key\":\"***\",\"cid-gravity-strict\":false,\"concurrent-imports-limit\":0,\"conn-grace\":120000000000,\"conn-high\":512,\"conn-low\":256,\"deal-data-fetch-attempts\":3,\"deal-data-fetch-timeout\":\"3h\",\"deal-duration-max\":1468800,\"deal-duration-min\":525600,\"deal-size-max\":34359738368,\"deal-size-min\":57344,\"deal-start-window\":1200,\"discard-orphan-deals-after\":86400000000000,\"fake-mode\":false,\"fast-retrieval\":true,\"group\":\"\",\"http-port\":\"9999\",\"json\":true,\"listen-multiaddr\":[\"/ip4/0.0.0.0/tcp/4001\",\"/ip4/0.0.0.0/udp/4001/quic\"],\"log-debug\":false,\"log-json\":true,\"log-plaintext\":false,\"lotus-api-conn-retries\":\"2\",\"lotus-gateway-url\":\"https://api.node.glif.io\",\"lotus-market-api-maddr\":\"\",\"lotus-market-api-token\":\"***\",\"lotus-miner-api-maddr\":\"/ip4/172.16.0.1/tcp/2345/http\",\"lotus-miner-api-token\":\"***\",\"mdns\":false,\"miner-addr\":\"f01392893\",\"nat\":false,\"private-key\":\"***\",\"quic\":false,\"running-bytes-limit\":\"1 tb/24h\",\"sealing-sectors-limit\":700,\"status\":\"\",\"storage-provider-id\":\"f01392893\",\"user\":\"\",\"verified-ask-price\":0,\"wallet-addr-sig\":\"***\"}"}
    {"severity":"info","ts":"2021-11-03T20:02:35.079Z","logger":"bidbot/lotus","caller":"lotusclient/lotusclient.go:112","msg":"MarketListIncompleteDeals call took 618.817584ms"}
    {"severity":"info","ts":"2021-11-03T20:02:35.079Z","logger":"bidbot","caller":"bidbot/main.go:691","msg":"limit total running bytes to 1000000000000 bytes over 24h0m0s"}
    {"severity":"info","ts":"2021-11-03T20:02:35.103Z","logger":"psrpc/peer","caller":"peer/peer.go:154","msg":"marketpeer 12D3KooWDKfYWp8dyRvVgqcwHc8ys1ZNs8nEpGGBcw36VbPJJrqJ is online"}
    {"severity":"info","ts":"2021-11-03T20:02:35.560Z","logger":"bidbot/lotus","caller":"lotusclient/lotusclient.go:112","msg":"MarketListIncompleteDeals call took 454.529744ms"}
    {"severity":"info","ts":"2021-11-03T20:02:36.579Z","logger":"bidbot/service","caller":"service/service.go:251","msg":"service started"}
    {"severity":"info","ts":"2021-11-03T20:02:36.768Z","logger":"psrpc/peer","caller":"peer/peer.go:211","msg":"peer was bootstapped"}
    {"severity":"info","ts":"2021-11-03T20:02:36.768Z","logger":"bidbot/service","caller":"service/libp2p_pubsub.go:131","msg":"subscribed to the deal auction feed"}
    {"severity":"info","ts":"2021-11-03T20:02:36.768Z","logger":"bidbot/api","caller":"httpapi/httpapi.go:45","msg":"http server started at :9999"}
    {"severity":"info","ts":"2021-11-03T20:07:08.089Z","logger":"bidbot/service","caller":"service/service.go:315","msg":"auction details:\n{\n  \"id\": \"01fkkpk2mk4ndy20xeq6z8ra3g\",\n  \"payload_cid\": \"bafybeighevg5x246olzuzgcct4j3adg47w32pxwix7knnnofnaqugxo3ji\",\n  \"deal_size\": 34359738368,\n  \"deal_duration\": 1468800,\n  \"fil_epoch_deadline\": 1259774,\n  \"sources\": {\n    \"car_url\": {\n      \"URL\": \"https://cargo.web3.storage/deal-cars/bafybeighevg5x246olzuzgcct4j3adg47w32pxwix7knnnofnaqugxo3ji_baga6ea4seaqo2w6ikje6zfgst4exeaky23qm7qm4pqio64kbujinden2b3shipa.car\"\n    }\n  },\n  \"ends_at\": {\n    \"seconds\": 1635970058,\n    \"nanos\": 21169966\n  },\n  \"client_address\": \"f144zep4gitj73rrujd3jw6iprljicx6vl4wbeavi\"\n}"}
    {"severity":"info","ts":"2021-11-03T20:07:09.002Z","logger":"bidbot/lotus","caller":"lotusclient/lotusclient.go:112","msg":"MarketListIncompleteDeals call took 453.919482ms"}
    {"severity":"info","ts":"2021-11-03T20:07:09.465Z","logger":"bidbot/pricing","caller":"pricing/cid_gravity.go:184","msg":"loading rules from API took 314.279983ms"}
    {"severity":"info","ts":"2021-11-03T20:07:09.466Z","logger":"bidbot/service","caller":"service/service.go:357","msg":"pricing engine result valid for auction 01fkkpk2mk4ndy20xeq6z8ra3g?: true, details: {AllowBidding:false UnverifiedPriceValid:false UnverifiedPrice:0 VerifiedPriceValid:false VerifiedPrice:0}"}
    

    Yet there's a bunch of files in the deal_data folder which seem to be stalled;

    total 1.8T
    drwxrwxr-x  2 master master  12K Nov  3 20:12 .
    -rw-rw-r--  1 master master  21G Nov  3 09:25 bafybeigtctpv6kpgxigojynuroromvpcj6kxyzv4cmra5bw3gkynaunjo4_01fkjgrfzcze7bnt7ktj7rvhy5
    -rw-rw-r--  1 master master  30G Nov  3 09:19 bafybeie4yoofzscufymdvojxrfbm5kncj5nsz5p3sfcrljacwpsx44543q_01fkjg0w0gb4xpkyaas1e118mt
    -rw-rw-r--  1 master master  23G Nov  3 09:01 bafybeif7kymjnrstnh3wxy43lwy4bydbbz5s5xpep6pwpl5vac4den5ghu_01fkjf2xv5t64jt18nb1h5vvxw
    -rw-rw-r--  1 master master  25G Nov  3 08:55 bafybeie7m62ibw2j6zmfxp5nnfkegdodserri74ayaxbj3mbxbxtyvan5a_01fkje7e5kw5177vmfj47gfzvq
    -rw-rw-r--  1 master master  20G Nov  3 08:40 bafybeibfn6ra2dlznvfiu5ydarob5x3gfve7hwsc6cjkfoiiwlhj57tdny_01fkjdxz88w27598655707c64t
    -rw-rw-r--  1 master master  21G Nov  3 08:33 bafybeigs5u2tctg2lpajqnezwnuh2viqhy3xtuto7wta42a2jphaecaova_01fkjdctf5pnajdfx69y898eyn
    -rw-rw-r--  1 master master  21G Nov  3 08:22 bafybeichgaotuheoo7fcym7kllsfax33yeishbxbrwcgvlejrbvwzkxq7m_01fkjctg2begdgw5mfdfa54z41
    -rw-rw-r--  1 master master  21G Nov  3 07:59 bafybeig6p7t4qoeidgrvo2zatsq3yftgso7pjwewypo2swbrvoygbowq2y_01fkjbmyrhsbp39vv0xbbq8qhr
    -rw-rw-r--  1 master master  21G Nov  3 07:52 bafybeidpkkb4onzyfy5xghkgnaakyc5bmuktdlvrrif4v6d63heuapt5ei_01fkjatbt4r7dgvfcwe6z9q177
    -rw-rw-r--  1 master master  32G Nov  3 07:34 bafybeibtnl6uerfdp2edfanv5ayqqyuor5zsmcgvmdnva4xftuoi4gnk4y_01fkj948g8437cmt1hc3mw5pq5
    -rw-rw-r--  1 master master  21G Nov  3 07:33 bafybeibycryjmhy2rjv2ncewakpyfi5karafst4pbc2mzrnmg362kdykf4_01fkj9wdavmfh8wwshda15hgvr
    -rw-rw-r--  1 master master  26G Nov  3 07:24 bafybeidpmrjjemn72wwlvmtyashwdtuc4dl5gp54egk67iwgktfivhctim_01fkj92d4wcgez2xp02rn6b8vc
    -rw-rw-r--  1 master master  24G Nov  3 07:01 bafybeih73ymmvp3aibipph6i62vv356lfkgl6x7mto2ydz57nffsj66ria_01fkj85das83dnj57hww2h5m0c
    -rw-rw-r--  1 master master  24G Nov  3 06:52 bafybeifn5iprkayex6d3pltfxfl4fsi2k3ahuje2jyehmgmhufwxbefbcu_01fkj7hjf1tvqe8zj3gpd13m0z
    -rw-rw-r--  1 master master  26G Nov  3 06:38 bafybeibwj3gfyzs4s746icytkcoocg4xdsreb7yj5hw5lhqy7dfuwl652e_01fkj6ebq6svtfpt7g2d64p71f
    -rw-rw-r--  1 master master  27G Nov  3 06:23 bafybeidqsfelbbi6ouxeuk27ppe4auxsvhmkieyknppozty3vxcxqayzpe_01fkj5p0dnsrx1wprtxte60h7t
    -rw-rw-r--  1 master master  31G Nov  3 06:08 bafybeiaxhndwzd6notby3wrz3shxkvege7ewkya3jmtms6d26jom72h4ae_01fkj5xm9er4dq8534nhebnyqq
    -rw-rw-r--  1 master master  25G Nov  3 05:57 bafybeigp67cltya2nzbah4p37i7teiswms4klz3xtfdjui5wl54xcasfym_01fkj4wasjbc99d8xw73gejg3w
    -rw-rw-r--  1 master master  23G Nov  3 05:30 bafybeibjupbc43d3oepxxmo52ih4nuleepj6tahnwn4pcxetrtuuvg5qsi_01fkj30axxdba3cnmtbrebtve7
    -rw-rw-r--  1 master master  25G Nov  3 05:24 bafybeign6orhkudpbon5hpej5y6fbd4lnwv57wx2e7yta2jhdmvh3mn564_01fkj2ky55rjjv024aa8n2x43r
    -rw-rw-r--  1 master master  30G Nov  3 05:22 bafybeifzcgobadnptmbdtgwenns5efjjqqfgcsqpltddhbmfa2vfhwf4ou_01fkj296702tkbmxq1nver0m92
    -rw-rw-r--  1 master master  24G Nov  3 04:45 bafybeib7knpefe73xztvjajl6su2twxwevbx45lcrzjn5j4n4yl2t7c6km_01fkj1chjyr50wrgk83j75ecb3
    -rw-rw-r--  1 master master  26G Nov  3 04:29 bafybeievwsqk4lcw2fgocosq424fdylnnxz3zxlvdqlm5ijwdapbleacg4_01fkj0dr0m5xjm2h10w2mybjrb
    -rw-rw-r--  1 master master  32G Nov  3 04:20 bafybeih3ibsb5q2zc2f772ptch3dlm2vkplqnjsact3aq4devxmes3werq_01fkhzq096qvfgcrpr80dtct0w
    -rw-rw-r--  1 master master  16G Nov  3 03:58 bafybeia4ipunfeylgzawpfrk27ipjv4gk4toe7g3liiqxkeqkqxa4dmjae_01fkhyprqna5qhxs68djhe5231
    -rw-rw-r--  1 master master  28G Nov  3 03:57 bafybeiflfvthxfeizyalpgkrszo37svu6hzagbiobbw6sx6o7gthac6ddm_01fkhyc9xs2w1pntf11kj6fds6
    -rw-rw-r--  1 master master  32G Nov  3 03:48 bafybeiciconuoskg2eiquwjyo6dlx6hj7vgp4ovfpjznh3wgjgsyishdsu_01fkhxv5hzpmwgsqf5t9yjpscm
    -rw-rw-r--  1 master master  24G Nov  3 03:30 bafybeic4htnyipgnmqxtv3gpcc544le6p563yuhmsgnplzdoa4ynwokyzm_01fkhwzp8yd06zbg6e02te3ayj
    -rw-rw-r--  1 master master  25G Nov  3 03:16 bafybeibxpuiq6zripfdbrzpyra5r4f3czxsii77m5tn3p4rw7tjoq2pn2u_01fkhw46cv1th83221akd66mdj
    -rw-rw-r--  1 master master  15G Nov  2 13:37 bafybeiezu7jl2s5m6qvficq5va6p5n7xet5ehr6v5pyqwwscarhe5hekte_01fkfv18x4x8y9nrnv75f9xcd0
    -rw-rw-r--  1 master master  19G Nov  2 08:13 bafybeiadyrw74ixov77qkls7vixa3kyujwwr4ctpc2jiv47cf6mymamtsq_01fkftffvzaa6s8djfw45edx63
    -rw-rw-r--  1 master master  26G Nov  2 08:08 bafybeigs2fpewvo5sdqp57jcrik4f6dtwfryvefgejaskk6rlg4g2cjxjm_01fkfth2cgbaa74394f14g5ptr
    -rw-rw-r--  1 master master  32G Nov  2 08:07 bafybeiad6br7apkwkroygzapt6fyh2srvhu6lggbhmpioty7hnooulvhe4_01fkfsjgp4aq1bjcrb8mbpcqtj
    -rw-rw-r--  1 master master  31G Nov  2 07:56 bafybeie4rngzw7sokov2lhztatahe2rach6syttkbvc5ltbwmromd7wr5m_01fkfs7eqh90e5ysm6eaksbqe4
    -rw-rw-r--  1 master master  30G Nov  2 07:47 bafybeicxe6cyx6ptckpgc6zpaj6egd44mhqw5rlm5lweltuounb6uxggfm_01fkfrrhs0hc12n75sy5m5cmtb
    -rw-rw-r--  1 master master  32G Nov  2 07:36 bafybeihtxvsq47wjybmlko5pmh4d56ntjeohu3hcn5h5tfy4uqqi3n2u6m_01fkfr8wkah9npscbrbm45xg4h
    -rw-rw-r--  1 master master  32G Nov  2 07:07 bafybeihi5hyalhuim5qawyszgamysvlbmw5i4yyesgowb3i7tlmxnqbqhu_01fkfnpynkbs3qbd6zf6aj5esp
    -rw-rw-r--  1 master master  32G Nov  2 07:03 bafybeiffhxc3s4g5hy7mu4reacpscfwwazhyknnfdmlvwradjxeb77mfa4_01fkfnnexw1t96z42b19cx29y9
    -rw-rw-r--  1 master master  27G Nov  2 06:55 bafybeidqolrw2u4wxbzgw3rcnwyfhb5im4grq34h4hgf6wh53ztxcqp5ba_01fkfmwasf11gn6c5w1p8bqxqc
    -rw-rw-r--  1 master master  30G Nov  2 06:48 bafybeiadkkcggreyh6jgnqejbojoaqojgd3mkmw2ceqw3lvp2pj4m7krgi_01fkfmk62wnfrrth9hcg16bcgh
    -rw-rw-r--  1 master master  30G Nov  2 06:40 bafybeiesqwzpwzxwmkzpyhosbkv3q5u65mx35abt63zqvwom2epm7wem7q_01fkfmbzc9zff7dcdqcmef0f6v
    -rw-rw-r--  1 master master  27G Nov  2 06:33 bafybeihi57l6ejwi77vjzj6rdt3xoddc7rcyyop5vrokjb6v5qxj63toru_01fkfkzty2vjjtarhz1hzbwd44
    -rw-rw-r--  1 master master  32G Nov  2 06:09 bafybeicf5763fastfcrmb2xam46a6p2i6axprzsdzwcgh6a5gwajxlcgla_01fkfkrbrajj0ays7dqgy8h8zq
    -rw-rw-r--  1 master master  31G Nov  2 05:49 bafybeifubqh44kdnw63ihev4hfmuthy3x4xfkdzlolwnimkhdjvzrmtv7e_01fkfhmyyejjqfw9xk3mdr721h
    -rw-rw-r--  1 master master  29G Nov  2 05:32 bafybeifb5qnm6d3acthjzmyyo7fge3z6dxai4bkt7qaxzbxxzqr74rypae_01fkfgnxdbkkrbt60hb4wfk5ak
    -rw-rw-r--  1 master master  28G Nov  2 05:17 bafybeidacltsyubmjdh4wjwcg35z7ke24fovomeuezk7prj6vw74rh4vma_01fkffncahj1sdrb7q801xwq7s
    -rw-rw-r--  1 master master  32G Nov  2 05:15 bafybeifr6ej64ajzrpa6ita3urqt2sjoe6ojcfpnyfr4xhyhn62bjvwixe_01fkff6qgpt3h9sq225b0d91kc
    -rw-rw-r--  1 master master  30G Nov  2 04:35 bafybeihflqh3zppx24inolgsyknfnjqcta5s4f74julp2wugiv2sisr33a_01fkf9yw07wbhm3hmm9b8dgb93
    -rw-rw-r--  1 master master  30G Nov  2 04:25 bafybeihmvwf6lptxpthk4tzrxztl6cl6dq5ybmdk4t4iztlxwekrdhgnwu_01fkf9v9q757y97fpj6www1ncn
    -rw-rw-r--  1 master master  24G Nov  2 04:11 bafybeigsglehzur27m4hsfmxgm5ldsr7zn7w2yz2x6apivywlmghc7vhei_01fkf9djwzt7b2gfwj0pszrg99
    -rw-rw-r--  1 master master  32G Nov  2 03:53 bafybeielycmao4o32ghipnklvyzbxx5b6hmx6na5mxxtinus5qap6swcl4_01fkf7e4sketq4b0v0zs64tkab
    -rw-rw-r--  1 master master  27G Nov  2 03:37 bafybeid6ottb74zbvgainzysf77uyn7hezm5ivrpra2awklttvxkkbwzz4_01fkf46taqx937bfq765dh4fr0
    -rw-rw-r--  1 master master  31G Nov  2 03:32 bafybeiavrxmxbsf3ygoubocar25chsjqikgts3aqgzt537mmygt7zln37q_01fkf3qhz26v9rcwrqhmygy8pd
    -rw-rw-r--  1 master master  31G Nov  2 03:06 bafybeidn7zxobnm6ocnis4xp5s6nj3ecghfxqtq62f35ydr5lw2r67r7ja_01fkf0xmpbxah298dqycn6rncs
    -rw-rw-r--  1 master master  32G Nov  2 02:59 bafybeifhgay6wr6wmzbk2u4q333otzc2ifbg6hyru6rdrgacoca7zqjdme_01fkf0nd333rj3510ta6kzas9q
    -rw-rw-r--  1 master master  32G Nov  2 02:51 bafybeiggenrxj65eexfqrak3ro6snt64ijv4dxpqzh5vwxiqtvmfh22vju_01fkezpmczvp7hhh0schnnjmv4
    -rw-rw-r--  1 master master  29G Nov  2 02:20 bafybeicmbycsbqxixhf646ncx4fhagcr2qqg4gadrrg2luoh5a2zfjlxpu_01fkezgz4x0ej9k6yfc8ejqdzg
    -rw-rw-r--  1 master master  30G Nov  2 02:09 bafybeid36ox7ha6e4bwraepwkjy2elbdhwrdu7ixn6z2fpyfh6b6rsltau_01fkez29drs9c1d942vs5zpyay
    -rw-rw-r--  1 master master  32G Nov  2 02:02 bafybeibgshxykdtbss3dggofw4cx3j63zqoe4yxmb27vdvtkaxygteiqii_01fkeyr5r1m72jec2fj7ev866d
    -rw-rw-r--  1 master master  30G Nov  2 01:32 bafybeie5uuza34jj44gc3klyh74jpdzkfmbo772xsthtrfwjkabamiognu_01fkeyhb7eq0ykp4p9jpr66hje
    -rw-rw-r--  1 master master  32G Nov  2 01:16 bafybeibvkah2lxq73iaajhatieznggv327p4spx4akqmiprg25vchlzbua_01fkeyapx3j5dkmma8rf6efhze
    -rw-rw-r--  1 master master  30G Nov  2 01:12 bafybeibikijje4knqpyezsbaiqdhnv5yoahg3onh3tnlp76z273xrf433y_01fkey91fngjk4dr4nfpabsk35
    -rw-rw-r--  1 master master  29G Nov  2 00:48 bafybeibz4phsxhxrjfvhpzfwh36mogbgdsvseyyx3fuvnakjfo47rizzvy_01fkewzpryt515g7jtj4fksw1j
    -rw-rw-r--  1 master master  23G Nov  2 00:29 bafybeierwok5eqomh4gpinfgat2r4chq6dagvkxxqjagneosjfkh7dsxs4_01fkexw4c7fxnxx3dve692ppag
    -rw-rw-r--  1 master master  31G Nov  2 00:25 bafybeic2qe3yaz237u53xaugfkcsijs3x5dehxnbmrbse33s25sxsmg3ta_01fkexn7fa096br0nqj42afbes
    -rw-rw-r--  1 master master  31G Nov  2 00:05 bafybeiaqv5e4m2mk6zc237qph73xjez7vujuzw77pz5j6frkzsby6rtb3a_01fkewy7v156a3j34hgbfcfbra
    -rw-rw-r--  1 master master  32G Nov  1 23:56 bafybeidskwu6jjr4pa2zt3grkc5fvm2b4sn5dcv3f4tnuqvansbh3xuv24_01fkewdbe3yesnynvy0p2qgxhj
    

    The top one for example is this deal;

    {
            "ID": "01fkjgrfzcze7bnt7ktj7rvhy5",
            "AuctionID": "01fkjgrdwzhvk1xdg52jh6pcej",
            "AuctioneerID": "12D3KooW9wsxrkCx6CnsWb1gBxZWAjzVK5Hif9FLXKoQZYLewXoD",
            "PayloadCid": {
                    "/": "bafybeigtctpv6kpgxigojynuroromvpcj6kxyzv4cmra5bw3gkynaunjo4"
            },
            "DealSize": 34359738368,
            "DealDuration": 1468800,
            "ClientAddress": "f144zep4gitj73rrujd3jw6iprljicx6vl4wbeavi",
            "Sources": {
                    "CARURL": {
                            "URL": {
                                    "Scheme": "https",
                                    "Opaque": "",
                                    "User": null,
                                    "Host": "cargo.web3.storage",
                                    "Path": "/deal-cars/bafybeigtctpv6kpgxigojynuroromvpcj6kxyzv4cmra5bw3gkynaunjo4_baga6ea4seaqiatabkeg2ehng4fpj6rr3wr6urnowpy3tyysveqcswgysecneofq.car",
                                    "RawPath": "",
                                    "ForceQuery": false,
                                    "RawQuery": "",
                                    "Fragment": "",
                                    "RawFragment": ""
                            }
                    },
                    "CARIPFS": null
            },
            "Status": 5,
            "AskPrice": 0,
            "VerifiedAskPrice": 0,
            "StartEpoch": 1255331,
            "FastRetrieval": true,
            "ProposalCid": {
                    "/": "bafyreiahqvz4g66st7jdsq5kf56kq3fm3qthvbu3dsrbbhvymdjmpso7vu"
            },
            "DataURIFetchAttempts": 1,
            "CreatedAt": "2021-11-03T09:05:58.258399976Z",
            "UpdatedAt": "2021-11-03T09:28:34.305728628Z",
            "ErrorCause": ""
    }
    

    What is it doing? Should it not continue to download and then pack the data?

    opened by RobQuistNL 2
  • common: properly handle SIGTERM for k8

    common: properly handle SIGTERM for k8

    This was only considering SIGINT, and not SIGTERM which is sent by k8 for graceful termination. Since we use this common package for all SB daemons, means that all of them weren't closing gracefully.

    I'll update the dependency on all places in the other repo when merged.

    opened by jsign 2
  • Auctioneer returned error: response not received

    Auctioneer returned error: response not received

    Recieved an auction, but when the bidbot was trying to publish the bid it errored out with a response not recieved.

    2021-07-08T05:58:30.452+0200	INFO	bidbot/service	service/service.go:317	received auction 01fa248pyev3hzjvh722aw10hm from 12D3KooW9wsxrkCx6CnsWb1gBxZWAjzVK5Hif9FLXKoQZYLewXoD: 
    {
      "id": "01fa248pyev3hzjvh722aw10hm",
      "payload_cid": "bafybeidmmgrnlo3bg4earr43i3tvsjvn4kn2vtbdmenkxlaldrnwuvimku",
      "deal_size": 4294967296,
      "deal_duration": 1468800,
      "sources": {
        "car_url": {
          "URL": "https://broker.staging.textile.dev/car/bafybeidmmgrnlo3bg4earr43i3tvsjvn4kn2vtbdmenkxlaldrnwuvimku"
        }
      },
      "ends_at": {
        "seconds": 1625716720,
        "nanos": 350875922
      }
    }
    2021-07-08T05:58:40.443+0200	INFO	bidbot/service	service/service.go:317	received auction 01fa248pyev3hzjvh722aw10hm from 12D3KooW9wsxrkCx6CnsWb1gBxZWAjzVK5Hif9FLXKoQZYLewXoD: 
    {
      "id": "01fa248pyev3hzjvh722aw10hm",
      "payload_cid": "bafybeidmmgrnlo3bg4earr43i3tvsjvn4kn2vtbdmenkxlaldrnwuvimku",
      "deal_size": 4294967296,
      "deal_duration": 1468800,
      "sources": {
        "car_url": {
          "URL": "https://broker.staging.textile.dev/car/bafybeidmmgrnlo3bg4earr43i3tvsjvn4kn2vtbdmenkxlaldrnwuvimku"
        }
      },
      "ends_at": {
        "seconds": 1625716730,
        "nanos": 362617129
      }
    }
    2021-07-08T05:58:50.454+0200	INFO	bidbot/service	service/service.go:317	received auction 01fa248pyev3hzjvh722aw10hm from 12D3KooW9wsxrkCx6CnsWb1gBxZWAjzVK5Hif9FLXKoQZYLewXoD: 
    {
      "id": "01fa248pyev3hzjvh722aw10hm",
      "payload_cid": "bafybeidmmgrnlo3bg4earr43i3tvsjvn4kn2vtbdmenkxlaldrnwuvimku",
      "deal_size": 4294967296,
      "deal_duration": 1468800,
      "sources": {
        "car_url": {
          "URL": "https://broker.staging.textile.dev/car/bafybeidmmgrnlo3bg4earr43i3tvsjvn4kn2vtbdmenkxlaldrnwuvimku"
        }
      },
      "ends_at": {
        "seconds": 1625716740,
        "nanos": 373591008
      }
    }
    2021-07-08T05:59:00.933+0200	INFO	bidbot/service	service/service.go:431	bidding in auction 01fa248pyev3hzjvh722aw10hm from 12D3KooW9wsxrkCx6CnsWb1gBxZWAjzVK5Hif9FLXKoQZYLewXoD: 
    {
      "auction_id": "01fa248pyev3hzjvh722aw10hm",
      "miner_addr": "f023467",
      "wallet_addr_sig": "ApGrZvAGoxp6e9eZzTttipFXfuGQMl+jthccfYNYsgWUPDa+WaRfR7TU5r/sl6uC2BPN8ygyG//spbkzwhCygYVc8eYch0iGt2ZtBBEn04k1/5jw664JtDzr7kzxYfHcaQ==",
      "start_epoch": 916557,
      "fast_retrieval": true
    }
    2021-07-08T05:59:10.934+0200	ERROR	bidbot/service	service/service.go:321	making bid: publishing bid; auctioneer 12D3KooW9wsxrkCx6CnsWb1gBxZWAjzVK5Hif9FLXKoQZYLewXoD returned error: response not received
    2021-07-08T05:59:13.674+0200	INFO	bidbot/service	service/service.go:431	bidding in auction 01fa248pyev3hzjvh722aw10hm from 12D3KooW9wsxrkCx6CnsWb1gBxZWAjzVK5Hif9FLXKoQZYLewXoD: 
    {
      "auction_id": "01fa248pyev3hzjvh722aw10hm",
      "miner_addr": "f023467",
      "wallet_addr_sig": "ApGrZvAGoxp6e9eZzTttipFXfuGQMl+jthccfYNYsgWUPDa+WaRfR7TU5r/sl6uC2BPN8ygyG//spbkzwhCygYVc8eYch0iGt2ZtBBEn04k1/5jw664JtDzr7kzxYfHcaQ==",
      "start_epoch": 916558,
      "fast_retrieval": true
    }
    2021-07-08T05:59:20.885+0200	ERROR	bidbot/service	service/service.go:321	making bid: creating bids topic: creating topic: joining topic: topic already exists
    2021-07-08T05:59:23.675+0200	ERROR	bidbot/service	service/service.go:321	making bid: publishing bid; auctioneer 12D3KooW9wsxrkCx6CnsWb1gBxZWAjzVK5Hif9FLXKoQZYLewXoD returned error: response not received
    
    opened by rjan90 2
  • Bidbot: Command not found

    Bidbot: Command not found

    Hey! Tried to install the bidbot by building from source. I followed the installation docs, but get bidbot: command not found, when I try to use bidbot init.

    go version: go version go1.16.4 linux/amd64

    Install logs:

    make install
    (re)installing /home/sealworker3/go/bin/govvv-v0.3.0
    go: downloading github.com/ahmetb/govvv v0.3.0
    CGO_ENABLED=0 go install -ldflags="-X github.com/textileio/bidbot/buildinfo.BuildDate=2021-07-07T10:48:55Z -X github.com/textileio/bidbot/buildinfo.GitCommit=1b9df01 -X github.com/textileio/bidbot/buildinfo.GitBranch=main -X github.com/textileio/bidbot/buildinfo.GitState=clean -X github.com/textileio/bidbot/buildinfo.GitSummary=v0.0.2-2-g1b9df01 -X github.com/textileio/bidbot/buildinfo.Version=git" .
    go: downloading github.com/joho/godotenv v1.3.0
    go: downloading github.com/spf13/cobra v1.1.3
    go: downloading github.com/spf13/viper v1.8.1
    go: downloading github.com/textileio/go-log/v2 v2.1.3-gke-1
    go: downloading github.com/multiformats/go-multiaddr v0.3.3
    go: downloading github.com/libp2p/go-libp2p-core v0.8.5
    go: downloading github.com/hashicorp/go-multierror v1.1.1
    go: downloading github.com/oklog/ulid v1.3.1
    go: downloading google.golang.org/protobuf v1.27.1
    go: downloading github.com/spf13/pflag v1.0.5
    go: downloading go.opentelemetry.io/contrib v0.21.0
    go: downloading go.opentelemetry.io/otel v1.0.0-RC1
    go: downloading github.com/gogo/status v1.1.0
    go: downloading google.golang.org/grpc v1.39.0
    go: downloading github.com/filecoin-project/lotus v1.10.0
    go: downloading github.com/textileio/go-ds-badger3 v0.0.0-20210324034212-7b7fb3be3d1c
    go: downloading github.com/textileio/go-ds-mongo v0.1.4
    go: downloading github.com/textileio/go-datastore-extensions v1.0.1
    go: downloading github.com/multiformats/go-multiaddr-dns v0.3.1
    go: downloading github.com/sanderpick/ipfs-lite v1.1.20-0.20210603231246-4c7bb79224a9
    go: downloading github.com/ipfs/go-ipfs-blockstore v1.0.4
    go: downloading github.com/ipfs/go-ipfs-config v0.14.0
    go: downloading github.com/libp2p/go-libp2p v0.14.3
    go: downloading github.com/libp2p/go-libp2p-peerstore v0.2.7
    go: downloading github.com/libp2p/go-libp2p-pubsub v0.4.2-0.20210517161200-e6ad80cf4782
    go: downloading github.com/oklog/ulid/v2 v2.0.2
    go: downloading github.com/libp2p/go-libp2p-quic-transport v0.11.1
    go: downloading go.opentelemetry.io/contrib/instrumentation/runtime v0.21.0
    go: downloading go.uber.org/zap v1.18.1
    go: downloading github.com/multiformats/go-multihash v0.0.15
    go: downloading github.com/ipfs/go-log v1.0.5
    go: downloading go.opencensus.io v0.23.0
    go: downloading go.opentelemetry.io/otel/exporters/prometheus v0.21.0
    go: downloading go.opentelemetry.io/otel/metric v0.21.0
    go: downloading go.opentelemetry.io/otel/sdk v1.0.0-RC1
    go: downloading github.com/google/uuid v1.2.0
    go: downloading github.com/gogo/googleapis v1.4.0
    go: downloading github.com/gogo/protobuf v1.3.2
    go: downloading github.com/dgraph-io/badger/v3 v3.2011.1
    go: downloading google.golang.org/genproto v0.0.0-20210602131652-f16073e35f0c
    go: downloading github.com/golang/protobuf v1.5.2
    go: downloading github.com/miekg/dns v1.1.41
    go: downloading github.com/benbjohnson/clock v1.1.0
    go: downloading go.mongodb.org/mongo-driver v1.4.0
    go: downloading go.opentelemetry.io/otel/sdk/export/metric v0.21.0
    go: downloading go.opentelemetry.io/otel/sdk/metric v0.21.0
    go: downloading github.com/fsnotify/fsnotify v1.4.9
    go: downloading github.com/hashicorp/hcl v1.0.0
    go: downloading github.com/magiconair/properties v1.8.5
    go: downloading github.com/pelletier/go-toml v1.9.3
    go: downloading github.com/mitchellh/mapstructure v1.4.1
    go: downloading github.com/spf13/afero v1.6.0
    go: downloading github.com/spf13/cast v1.3.1
    go: downloading github.com/spf13/jwalterweatherman v1.1.0
    go: downloading github.com/subosito/gotenv v1.2.0
    go: downloading gopkg.in/ini.v1 v1.62.0
    go: downloading gopkg.in/yaml.v2 v2.4.0
    go: downloading github.com/hashicorp/golang-lru v0.5.5-0.20210104140557-80c98217689d
    go: downloading github.com/ipfs/interface-go-ipfs-core v0.4.0
    go: downloading github.com/ipfs/go-bitswap v0.3.4
    go: downloading github.com/ipfs/go-ipfs-provider v0.5.1
    go: downloading github.com/ipfs/go-unixfs v0.2.6
    go: downloading github.com/libp2p/go-libp2p-kad-dht v0.12.1
    go: downloading github.com/btcsuite/btcd v0.21.0-beta
    go: downloading github.com/minio/sha256-simd v1.0.0
    go: downloading github.com/klauspost/compress v1.11.7
    go: downloading github.com/libp2p/go-netroute v0.1.6
    go: downloading github.com/lucas-clemente/quic-go v0.21.1
    go: downloading github.com/prometheus/client_golang v1.11.0
    go: downloading golang.org/x/crypto v0.0.0-20210506145944-38f3c27a63bf
    go: downloading go.opentelemetry.io/otel/internal/metric v0.21.0
    go: downloading github.com/multiformats/go-multistream v0.2.2
    go: downloading github.com/libp2p/go-libp2p-mplex v0.4.1
    go: downloading github.com/libp2p/go-libp2p-noise v0.2.0
    go: downloading github.com/libp2p/go-libp2p-yamux v0.5.4
    go: downloading github.com/libp2p/go-tcp-transport v0.2.3
    go: downloading github.com/libp2p/go-ws-transport v0.4.0
    go: downloading github.com/whyrusleeping/mdns v0.0.0-20190826153040-b9b60ed33aa9
    go: downloading golang.org/x/net v0.0.0-20210423184538-5f58ad60dda6
    go: downloading golang.org/x/sys v0.0.0-20210603081109-ebe580a85c40
    go: downloading golang.org/x/text v0.3.6
    go: downloading github.com/cenkalti/backoff v2.2.1+incompatible
    go: downloading go.opentelemetry.io/otel/trace v1.0.0-RC1
    go: downloading github.com/klauspost/cpuid/v2 v2.0.4
    go: downloading github.com/libp2p/go-libp2p-transport-upgrader v0.4.2
    go: downloading github.com/libp2p/go-libp2p-autonat v0.4.2
    go: downloading github.com/libp2p/go-conn-security-multistream v0.2.1
    go: downloading github.com/libp2p/go-libp2p-swarm v0.5.0
    go: downloading github.com/google/gopacket v1.1.19
    go: downloading github.com/libp2p/go-mplex v0.3.0
    go: downloading github.com/libp2p/go-yamux/v2 v2.2.0
    go: downloading github.com/marten-seemann/tcp v0.0.0-20210406111302-dfbc87cc63fd
    go: downloading github.com/mikioh/tcpinfo v0.0.0-20190314235526-30a79bb1804b
    go: downloading github.com/flynn/noise v1.0.0
    go: downloading github.com/prometheus/common v0.26.0
    go: downloading github.com/prometheus/procfs v0.6.0
    go: downloading github.com/dgraph-io/ristretto v0.0.4-0.20210122082011-bb5d392ed82d
    go: downloading github.com/huin/goupnp v1.0.1-0.20210310174557-0ca763054c88
    go: downloading github.com/mikioh/tcpopt v0.0.0-20190314235656-172688c1accc
    go: downloading github.com/davidlazar/go-crypto v0.0.0-20200604182044-b73af7476f6c
    go: downloading github.com/golang/snappy v0.0.3-0.20201103224600-674baa8c7fc3
    go: downloading github.com/google/flatbuffers v1.12.0
    go: downloading github.com/marten-seemann/qtls-go1-16 v0.1.3
    go: downloading github.com/go-stack/stack v1.8.0
    go: downloading github.com/aws/aws-sdk-go v1.32.11
    go: downloading github.com/xdg/scram v0.0.0-20180814205039-7eeb5667e42c
    go: downloading github.com/xdg/stringprep v0.0.0-20180714160509-73f8eece6fdc
    go: downloading golang.org/x/sync v0.0.0-20210220032951-036812b2e83c
    go: downloading github.com/ipfs/go-ipfs-http-client v0.1.0
    go: downloading github.com/ipfs/go-ipfs-cmds v0.6.0
    go: downloading github.com/rs/cors v1.7.0
    go: downloading github.com/jmespath/go-jmespath v0.4.0
    
    opened by rjan90 2
  • Bump go.opentelemetry.io/otel/metric from 0.25.0 to 0.32.1

    Bump go.opentelemetry.io/otel/metric from 0.25.0 to 0.32.1

    Bumps go.opentelemetry.io/otel/metric from 0.25.0 to 0.32.1.

    Changelog

    Sourced from go.opentelemetry.io/otel/metric's changelog.

    [0.32.1] Metric SDK (Alpha) - 2022-09-22

    Changed

    • The Prometheus exporter sanitizes OpenTelemetry instrument names when exporting. Invalid characters are replaced with _. (#3212)

    Added

    • The metric portion of the OpenCensus bridge (go.opentelemetry.io/otel/bridge/opencensus) has been reintroduced. (#3192)
    • The OpenCensus bridge example (go.opentelemetry.io/otel/example/opencensus) has been reintroduced. (#3206)

    Fixed

    • Updated go.mods to point to valid versions of the sdk. (#3216)
    • Set the MeterProvider resource on all exported metric data. (#3218)

    [0.32.0] Revised Metric SDK (Alpha) - 2022-09-18

    Changed

    • The metric SDK in go.opentelemetry.io/otel/sdk/metric is completely refactored to comply with the OpenTelemetry specification. Please see the package documentation for how the new SDK is initialized and configured. (#3175)
    • Update the minimum supported go version to go1.18. Removes support for go1.17 (#3179)

    Removed

    • The metric portion of the OpenCensus bridge (go.opentelemetry.io/otel/bridge/opencensus) has been removed. A new bridge compliant with the revised metric SDK will be added back in a future release. (#3175)
    • The go.opentelemetry.io/otel/sdk/metric/aggregator/aggregatortest package is removed, see the new metric SDK. (#3175)
    • The go.opentelemetry.io/otel/sdk/metric/aggregator/histogram package is removed, see the new metric SDK. (#3175)
    • The go.opentelemetry.io/otel/sdk/metric/aggregator/lastvalue package is removed, see the new metric SDK. (#3175)
    • The go.opentelemetry.io/otel/sdk/metric/aggregator/sum package is removed, see the new metric SDK. (#3175)
    • The go.opentelemetry.io/otel/sdk/metric/aggregator package is removed, see the new metric SDK. (#3175)
    • The go.opentelemetry.io/otel/sdk/metric/controller/basic package is removed, see the new metric SDK. (#3175)
    • The go.opentelemetry.io/otel/sdk/metric/controller/controllertest package is removed, see the new metric SDK. (#3175)
    • The go.opentelemetry.io/otel/sdk/metric/controller/time package is removed, see the new metric SDK. (#3175)
    • The go.opentelemetry.io/otel/sdk/metric/export/aggregation package is removed, see the new metric SDK. (#3175)
    • The go.opentelemetry.io/otel/sdk/metric/export package is removed, see the new metric SDK. (#3175)
    • The go.opentelemetry.io/otel/sdk/metric/metrictest package is removed. A replacement package that supports the new metric SDK will be added back in a future release. (#3175)
    • The go.opentelemetry.io/otel/sdk/metric/number package is removed, see the new metric SDK. (#3175)
    • The go.opentelemetry.io/otel/sdk/metric/processor/basic package is removed, see the new metric SDK. (#3175)
    • The go.opentelemetry.io/otel/sdk/metric/processor/processortest package is removed, see the new metric SDK. (#3175)
    • The go.opentelemetry.io/otel/sdk/metric/processor/reducer package is removed, see the new metric SDK. (#3175)
    • The go.opentelemetry.io/otel/sdk/metric/registry package is removed, see the new metric SDK. (#3175)
    • The go.opentelemetry.io/otel/sdk/metric/sdkapi package is removed, see the new metric SDK. (#3175)
    • The go.opentelemetry.io/otel/sdk/metric/selector/simple package is removed, see the new metric SDK. (#3175)
    • The "go.opentelemetry.io/otel/sdk/metric".ErrUninitializedInstrument variable was removed. (#3175)
    • The "go.opentelemetry.io/otel/sdk/metric".ErrBadInstrument variable was removed. (#3175)

    ... (truncated)

    Commits

    Dependabot compatibility score

    Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.


    Dependabot commands and options

    You can trigger Dependabot actions by commenting on this PR:

    • @dependabot rebase will rebase this PR
    • @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
    • @dependabot merge will merge this PR after your CI passes on it
    • @dependabot squash and merge will squash and merge this PR after your CI passes on it
    • @dependabot cancel merge will cancel a previously requested merge and block automerging
    • @dependabot reopen will reopen this PR if it is closed
    • @dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
    • @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)
    dependencies 
    opened by dependabot[bot] 0
  • Lotus and bidbot displays error  'Filecoin.SectorsSummary' not found

    Lotus and bidbot displays error 'Filecoin.SectorsSummary' not found

    Running Lotus v1.16.1 and Boost 1.2.0 along with CID-Gravity integration, I am seeing these errors very often. I assume this is due to a change in Boost or Lotus.

    Here is my bidbot run command: nohup bidbot daemon --storage-provider-id f01278 --cid-gravity-key <token redacted> --sealing-sectors-limit 8 >> /market/logs/bidbot.log 2>&1 &

    Boost log

    2022-07-17T03:34:49.420Z ERROR rpc [email protected]/server.go:95 RPC Error: method 'Filecoin.SectorsSummary' not found

    Bidbot log

    2022-07-17T03:34:49.420Z ERROR bidbot/service service/service.go:340 fail to get number of sealing sectors, continuing: getting lotus sectors summary: RPC error (-32601): method 'Filecoin.SectorsSummary' not found

    bidbot version

    version: git build date: 2022-06-28T12:08:11Z git summary: v0.1.14-7-ge68a7ee git branch: main git commit: e68a7ee git state: clean

    opened by stuberman 0
  • FR: Add max download speed option

    FR: Add max download speed option

    G'day I think it would be fantastic to have a max download speed config option to allow SPs to limit the max a single BB download can pull down at one time.

    The running-bytes-limit flag lets you set it over a period of time but doesn't let you limit any downloads to a max of 50MB/s etc etc

    Feature similar to the --max-overall-download-limit flag in aria2c

    opened by marshyonline 0
  • Bump github.com/stretchr/testify from 1.7.0 to 1.8.0

    Bump github.com/stretchr/testify from 1.7.0 to 1.8.0

    Bumps github.com/stretchr/testify from 1.7.0 to 1.8.0.

    Commits

    Dependabot compatibility score

    Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.


    Dependabot commands and options

    You can trigger Dependabot actions by commenting on this PR:

    • @dependabot rebase will rebase this PR
    • @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
    • @dependabot merge will merge this PR after your CI passes on it
    • @dependabot squash and merge will squash and merge this PR after your CI passes on it
    • @dependabot cancel merge will cancel a previously requested merge and block automerging
    • @dependabot reopen will reopen this PR if it is closed
    • @dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
    • @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)
    dependencies 
    opened by dependabot[bot] 0
  • Bump github.com/spf13/cobra from 1.1.3 to 1.5.0

    Bump github.com/spf13/cobra from 1.1.3 to 1.5.0

    Bumps github.com/spf13/cobra from 1.1.3 to 1.5.0.

    Release notes

    Sourced from github.com/spf13/cobra's releases.

    v1.5.0

    Spring 2022 Release 🌥️

    Hello everyone! Welcome to another release of cobra. Completions continue to get better and better. This release adds a few really cool new features. We also continue to patch versions of our dependencies as they become available via dependabot. Happy coding!

    Active help 👐🏼

    Shout out to @​marckhouzam for a big value add: Active Help spf13/cobra#1482. With active help, a program can provide some inline warnings or hints for users as they hit tab. Now, your CLIs can be even more intuitive to use!

    Currently active help is only supported for bash V2 and zsh. Marc wrote a whole guide on how to do this, so make sure to give it a good read to learn how you can add this to your cobra code! https://github.com/spf13/cobra/blob/master/active_help.md

    Group flags 🧑🏼‍🤝‍🧑🏼

    Cobra now has the ability to mark flags as required or exclusive as a group. Shout out to our newest maintainer @​johnSchnake for this! spf13/cobra#1654 Let's say you have a username flag that MUST be partnered with a password flag. Well, now, you can enforce those as being required together:

    rootCmd.Flags().StringVarP(&u, "username", "u", "", "Username (required if password is set)")
    rootCmd.Flags().StringVarP(&pw, "password", "p", "", "Password (required if username is set)")
    rootCmd.MarkFlagsRequiredTogether("username", "password")
    

    Flags may also be marked as "mutally exclusive" with the MarkFlagsMutuallyExclusive(string, string ... ) command API. Refer to our user guide documentation for further info!

    Completions 👀

    Documentation 📝

    ... (truncated)

    Commits

    Dependabot compatibility score

    Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.


    Dependabot commands and options

    You can trigger Dependabot actions by commenting on this PR:

    • @dependabot rebase will rebase this PR
    • @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
    • @dependabot merge will merge this PR after your CI passes on it
    • @dependabot squash and merge will squash and merge this PR after your CI passes on it
    • @dependabot cancel merge will cancel a previously requested merge and block automerging
    • @dependabot reopen will reopen this PR if it is closed
    • @dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
    • @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)
    dependencies 
    opened by dependabot[bot] 0
  • 'invalid miner address or signature' in logs

    'invalid miner address or signature' in logs

    I'm seeing a lot of invalid miner address or signature error messages in logs, along with verifying miner address: calling full node state miner info: RPC client error: sendRequest failed: http status 503 Service Unavailable unmarshaling response: invalid character '<' looking for beginning of value. My miner (f010088) was able to get some deals recently, so the error may be happening intermittently. I've tried re-initializing the bidbot repo (signing a new verification message), and changing Lotus API gateway URL in the bidbot config, but this error persists.

    opened by cerblue 1
Releases(v0.1.14)
  • v0.1.14(Apr 27, 2022)

    This is a recommended update for all storage providers.

    This update allows the storage to receive Boost deals if it's running boost. If boost isn't running, it will continue to receive deals as usual with the legacy (current) deal proposal protocol.

    To reiterate: it's safe to update to this version even if you're not running Boost.

    --Note for storage providers running Boost-- For some time, we'll add a whitelist on the backend side to allow specific storage providers receive deals when running boost. This allows everybody to ramp up Boost usage in a controlled fashion.

    If you're running Boost and want to allow bidbot to receive deals through Boost and not the legacy protocol, please ping @jsign (Filecoin slack, or Textile discord server) so it can add your storage provider id to the Boost whitelist.

    Source code(tar.gz)
    Source code(zip)
  • v0.1.13(Apr 25, 2022)

    This new release adjusts to a change in Cid Gravity API regarding the Verified field. For more information, see: https://github.com/textileio/bidbot/pull/104

    Source code(tar.gz)
    Source code(zip)
  • v0.1.12(Apr 14, 2022)

    • Add support for correct identification of sector states when the storage provider is using SnapDeals. This makes the --max-sealing-sectors flag has better precision in this case.

    Thanks to @magik6k and Angelo for their help in this version.

    Source code(tar.gz)
    Source code(zip)
  • v0.1.11(Mar 17, 2022)

    This version is an optional upgrade that contains a fix for bidbot configurations that have QUIC enabled. See: https://github.com/textileio/bidbot/issues/96

    Source code(tar.gz)
    Source code(zip)
  • v0.1.10(Mar 16, 2022)

    This release updates Lotus to v1.15 It indirectly also updates to:

    • [email protected] which has breaking APIs
    • go-libp2p-connmgr which has some other breaking APIs.
    • hsanjuan/go-ipfs-lite with a direct master commit that I've worked with Hector to fix dependency issues.
    • go-libp2p-pubsub-rpc that also adjusted reg indirect dependencies.

    There's no need to change storage providers configuration, just update the binary as usual.

    Source code(tar.gz)
    Source code(zip)
  • v0.1.9(Feb 24, 2022)

    This update is highly recommended.

    Changes:

    • We switch the API used for health checking since the previous one can have latency spikes that cascade into problems in processing the bid. See #91 for more information.
    Source code(tar.gz)
    Source code(zip)
  • v0.1.8(Feb 21, 2022)

    Changes:

    • Adds a flag that makes CurrentSealingSectors match lotus-side sector state accounting when that option is enabled on the lotus side. See PR.
    • Update Lotus dependency to v1.14.1.

    Thanks to @magik6k for his contributions.

    Source code(tar.gz)
    Source code(zip)
  • v0.1.7(Jan 11, 2022)

    Changes:

    • The provided --wallet-addr-sig can also be from the Worker wallet address. That's to say, both Owner and Worker signatures will work correctly.
    Source code(tar.gz)
    Source code(zip)
  • v0.1.6(Nov 4, 2021)

    Changes:

    • Comply with the new setup of cid-gravity rate limiting
    • Fix GC of CAR files for storage providers that have a symlink in their deals_data folder. https://github.com/textileio/bidbot/pull/72
    Source code(tar.gz)
    Source code(zip)
  • v0.1.5(Oct 27, 2021)

  • v0.1.4(Oct 14, 2021)

    Commits

    • 9cc4f17: Don't fetch data if the deal is already expired (Jinsub Moon) #63
    • 16491f3: mask more flags; print error loading config (Merlin Ran) #64
    • 8466a55: add commands to pause and resume bidding (Merlin Ran) #65
    • 20a981f: add install-service command [shipit] (Merlin Ran) #65
    • 38abb3c: code review updates (Merlin Ran) #65
    • 2d7c148: add doc about the newly added commands (Merlin Ran)
    Source code(tar.gz)
    Source code(zip)
    bidbot-linux-amd64(44.15 MB)
    LICENSE(1.04 KB)
  • v0.1.3(Oct 13, 2021)

  • v0.1.2(Oct 9, 2021)

    Commits

    • 9cb22bf: add protobuf definitions for the backchannel events (Merlin Ran) #57
    • d69df69: extract the communication channel to a separate package (Merlin Ran) #57
    • e167c2a: report various events back to auctioneer (Merlin Ran) #57
    • 7d11e23: remove the unused mongo store helper (Merlin Ran) #57
    • 64956fc: rename for better [shipit] (Merlin Ran) #57
    • 32d70a4: use a single topic for bidbot events reporting (Merlin Ran) #57
    Source code(tar.gz)
    Source code(zip)
    bidbot-linux-amd64(44.04 MB)
    LICENSE(1.04 KB)
  • v0.1.1(Oct 7, 2021)

  • v0.1.0(Sep 22, 2021)

    Commits

    • wire NetStruct #52 (Ignacio Hagopian)
    • db50bb6: slight updates to README mainly on winner selection (Merlin Ran) #53
    • 1d1ffa9: remove parallelism for more reliable CI (Merlin Ran)
    • 683eb26: add CID gravity integration (Merlin Ran) #50
    • 319ef9f: allow testing against staging cid gravity API [shipit] (Merlin Ran) #50
    • 642cde6: switch to the production CID gravity API (Merlin Ran) #50
    • 9e37e26: code review updates (Merlin Ran) #50
    Source code(tar.gz)
    Source code(zip)
    bidbot-linux-amd64(48.17 MB)
    LICENSE(1.04 KB)
  • v0.0.10(Sep 15, 2021)

    Commits

    • 973a861: use cli repo & update lotus (Ignacio Hagopian) #47
    • 4ac7f77: go mod tidy (Ignacio Hagopian) #47
    • d719b2a: treat files for not-finalized deals as orphans (Merlin Ran) #49
    • fce5262: linter + fix (Merlin Ran) #49
    • 56b9117: try pass linter on CI (Merlin Ran) #49
    • cb8560b: add test to cover removing manually downloaded files (Merlin Ran) #49
    • 920757f: use MarketListIncompleteDeals for health check (Merlin Ran) #48
    • 4bb6cd8: designate Go version when releasing [shipit] (Merlin Ran) #51
    Source code(tar.gz)
    Source code(zip)
    bidbot-linux-amd64(51.94 MB)
    LICENSE(1.04 KB)
  • v0.0.8(Sep 1, 2021)

  • v0.0.7(Aug 29, 2021)

    Bug Fixes

    Commits

    • 26e0823: add flag to limit the number of concurrent importing (Merlin Ran) #39
    • 7225972: Update README.md (Merlin Ran) #38
    • 64f2bdf: rename miner-addr to storage-provider-id (Merlin Ran) #37
    • b798753: ditch est-download-speed, add deal-data-fetch-timeout (Merlin Ran) #40
    • 4c25aae: Update README.md (Merlin Ran) #43
    • c400dba: fix running-bytes-limit and add test coverage (Merlin Ran) #44
    Source code(tar.gz)
    Source code(zip)
    bidbot-linux-amd64(56.91 MB)
    LICENSE(1.04 KB)
  • v0.0.6(Aug 13, 2021)

  • v0.0.5(Aug 13, 2021)

    Chores

    Commits

    • 68ce5b2: extract a common method to marshal config to json (Merlin Ran) #15
    • 0e111ff: a few less keystrokes passing masked fields (Merlin Ran) #15
    • 6d6bf99: move datauri as a shared package (Merlin Ran) #18
    • f2d7853: check if the number sealing sectors exceeds the limit before bidding (Merlin Ran) #20
    • 9e8f415: code review updates (Merlin Ran) #20
    • bc470e1: add a HTTP header to hint the server only the car header is needed (Merlin Ran) #21
    • bump version to include republishes on join #23 (Sander Pick)
    • move unused model to core #23 (Sander Pick)
    • 76ef7db: make deal-start-epoch a mandatory parameter (Merlin Ran) #24
    • fa8401a: have more descriptive error for unexpected status (Merlin Ran) #25
    • 464f657: ignore error if bid is already in BidStatusAwaitingProposal (Merlin Ran) #25
    • 615fc18: do not fail to SetProposalCid if bid is already pass the stage (Merlin Ran) #26
    • 633f7ee: Change where the deal_data-dir shoul be accessible (Rjan) #27
    • suggest throttling flag #29 (Ignacio Hagopian)
    • properly handle SIGTERM for k8 #30 (Ignacio Hagopian)
    • handle SIGQUIT #30 (Ignacio Hagopian)
    • dd67d3f: upgrade to the latest go-libp2p-pubsub-rpc (Merlin Ran) #31
    • 1bae0d2: remove internal commiting to make the logic more straightforward (Merlin Ran) #32
    Source code(tar.gz)
    Source code(zip)
    bidbot-linux-amd64(56.89 MB)
    LICENSE(1.04 KB)
  • v0.0.4(Jul 18, 2021)

    Commits

    Source code(tar.gz)
    Source code(zip)
    bidbot-linux-amd64(56.86 MB)
    LICENSE(1.04 KB)
  • v0.0.3(Jul 7, 2021)

  • v0.0.2(Jul 5, 2021)

  • v0.0.1(Jul 5, 2021)

Owner
textile.io
We're hiring!
textile.io
A minimal filecoin client library

filclient A standalone client library for interacting with the filecoin storage network Features Make storage deals with miners Query storage ask pric

Application Research Group 38 Sep 8, 2022
Descentralized object storage network for resilient services

Polar Descentralized object storage network for resilient services Polar is a binary that you can run on any linux distribution, it will expose a RPC

Coldwire 1 Mar 9, 2022
Package socket provides a low-level network connection type which integrates with Go's runtime network poller to provide asynchronous I/O and deadline support. MIT Licensed.

socket Package socket provides a low-level network connection type which integrates with Go's runtime network poller to provide asynchronous I/O and d

Matt Layher 44 Aug 3, 2022
Magma is an open-source software platform that gives network operators an open, flexible and extendable mobile core network solution.

Connecting the Next Billion People Magma is an open-source software platform that gives network operators an open, flexible and extendable mobile core

Magma 1.4k Sep 22, 2022
Optimize Windows's network/NIC driver settings for NewTek's NDI(Network-Device-Interface).

windows-ndi-optimizer[WIP] Optimize Windows's network/NIC driver settings for NewTek's NDI(Network-Device-Interface). How it works This is batchfile d

Nil Hiiragi 3 Apr 15, 2022
A simple network analyzer that capture http network traffic

httpcap A simple network analyzer that captures http network traffic. support Windows/MacOS/Linux/OpenWrt(x64) https only capture clienthello colorful

null 1 Nov 24, 2021
Zero Trust Network Communication Sentinel provides peer-to-peer, multi-protocol, automatic networking, cross-CDN and other features for network communication.

Thank you for your interest in ZASentinel ZASentinel helps organizations improve information security by providing a better and simpler way to protect

ZTALAB 6 Jul 30, 2022
Application written in Go which polls Time-series data at specific intervals and saves to persistent storage

TPoller Server Overview The purpose of this application is to poll time-series data per time interval from any (telemetry) application running a gRPC

Bartlomiej Mika 4 Feb 10, 2022
Fast time-series data storage server accessible over gRPC

tstorage-server Persistent fast time-series data storage server accessible over gRPC. tstorage-server is lightweight local on-disk storage engine serv

Bartlomiej Mika 6 Sep 14, 2022
Ananas is an experimental project for kubernetes CSI (Container Storage Interface) by using azure disk. Likewise, Ananas is the name of my cute british shorthair.

ananas Ananas is an experimental project for kubernetes CSI (Container Storage Interface) by using azure disk. Likewise, Ananas is the name of my cute

null 7 Aug 4, 2021
CSI driver NVMf mainly supports RDMA and TCP for Software Defined Storage by NVMf

CSI NVMf driver Overview This is a repository for NVMe-oF CSI Driver. Currently it implements bare minimum of th CSI spec. Requirements The CSI NVMf d

Kubernetes CSI 31 Aug 16, 2022
🍔 Product-storage service, work on gRPC. Client sends the URL to download products, and requests the result.

?? Product-storage service, work on gRPC. Client sends the URL to download products, and requests the result. The server transfer request to a third-party resource for .csv-file uploading and saves the products to own database.

Pavel V 9 Dec 16, 2021
This service is intented to collect data using grpc using Go lang backend and cassandra DB as storage

Go Data Collection This service is intented to collect data using grpc using Go lang backend and cassandra DB as storage. Dev Setup make test_env make

Daiem Ali 1 Apr 13, 2022
🚀Gev is a lightweight, fast non-blocking TCP network library based on Reactor mode. Support custom protocols to quickly and easily build high-performance servers.

gev 中文 | English gev is a lightweight, fast non-blocking TCP network library based on Reactor mode. Support custom protocols to quickly and easily bui

徐旭 1.5k Sep 21, 2022
gNXI Tools - gRPC Network Management/Operations Interface Tools

gNxI Tools gNMI - gRPC Network Management Interface gNOI - gRPC Network Operations Interface A collection of tools for Network Management that use the

Google 221 Sep 12, 2022
Simulate network link speed

linkio linkio provides an io.Reader and io.Writer that simulate a network connection of a certain speed, e.g. to simulate a mobile connection. Quick s

Ian Kent 52 Aug 8, 2022
NFF-Go -Network Function Framework for GO (former YANFF)

Network Function Framework for Go (former YANFF) Wonderful news : we are now supporting AF_XDP and supporting(almost) getting packets directly from Li

Intel Go Team 1.2k Sep 19, 2022
Send network packets over a TCP or UDP connection.

Packet is the main class representing a single network message. It has a byte code indicating the type of the message and a []byte type payload.

Aero 73 Aug 12, 2022
A cloud native distributed streaming network telemetry.

Panoptes Streaming Panoptes Streaming is a cloud native distributed streaming network telemetry. It can be installed as a single binary or clustered n

Yahoo 36 Jun 28, 2022