Home / JavaScript / Miscellaneous

Simulates a call to Convex Finance's system shutdown method, which uses about 16M gas

Convex System Shutdown Benchmarks This repository benchmarks performance of various Ethereum development frameworks by simulating a call to Convex's s
Information
Category: JavaScript / Miscellaneous
Watchers: 1
Star: 4
Fork: 0
Last update: Dec 2, 2021
Resource links
https://github.com/mds1/convex-shutdown-simulation

Convex System Shutdown Benchmarks

This repository benchmarks performance of various Ethereum development frameworks by simulating a call to Convex's systemShutdown method. This method uses about 16M gas and performs a number of token transfers

To run tests, make sure you have an environment variable called ETH_RPC_URL. Then use the following test commands:

  • Hardhat: yarn then yarn hardhat test --no-compile
  • Dapptools: dapp update then dapp test --rpc-url $ETH_RPC_URL
  • Foundry: forge test --rpc-url $ETH_RPC_URL
0 Open More issues
Closed

Expose ganache's "out of gas" error upon benchmarking

For ganache I disabled quiet logging and discovered that it's not actually executing the full transaction that's being benchmarked:

Simulating shutdown...
  eth_sendTransaction
  
    Transaction: 0x08af3eb8b0c5584aabb872319e3227308cca834ca16223b5bff2cc3750ed52c3
    Gas usage: 30000000
    Block number: 13724060
    Block time: Wed Jan 19 2022 00:55:41 GMT+0000 (Coordinated Universal Time)
    Runtime error: out of gas
  
  eth_chainId
  eth_getTransactionReceipt
  eth_blockNumber
  eth_chainId
simulate-shutdown: 11700.075ms

After adding the assertions:

Simulating shutdown...
  eth_sendTransaction
  
    Transaction: 0x08af3eb8b0c5584aabb872319e3227308cca834ca16223b5bff2cc3750ed52c3
    Gas usage: 30000000
    Block number: 13724060
    Block time: Wed Jan 19 2022 01:33:48 GMT+0000 (Coordinated Universal Time)
    Runtime error: out of gas
  
  eth_chainId
  eth_getTransactionReceipt
  eth_blockNumber
  eth_chainId
  AssertionError [ERR_ASSERTION]: transaction failed. receipt: {"to":"0xF403C135812408BFbE8713b5A23a04b3D48AAE31","from":"0xa3C5A1e09150B75ff251c1a7815A07182c3de2FB","contractAddress":null,"transactionIndex":0,"gasUsed":{"type":"BigNumber","hex":"0x01c9c380"},"logsBloom":"0x00000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000","blockHash":"0x3191002a084b22ac94f25bc18740c2c8c22c6ef6a4e1273cc6308ebc028aecd3","transactionHash":"0x08af3eb8b0c5584aabb872319e3227308cca834ca16223b5bff2cc3750ed52c3","logs":[],"blockNumber":13724060,"confirmations":1,"cumulativeGasUsed":{"type":"BigNumber","hex":"0x01c9c380"},"effectiveGasPrice":{"type":"BigNumber","hex":"0x0f8b9c7251"},"status":0,"type":2,"byzantium":true}
      at main (/convex-shutdown-simulation/scripts/convex.ganache.ts:54:10)
      at runNextTicks (internal/process/task_queues.js:62:5)
      at listOnTimeout (internal/timers.js:523:9)
      at processTimers (internal/timers.js:497:7) {
    generatedMessage: false,
    code: 'ERR_ASSERTION',
    actual: 0,
    expected: true,
    operator: '=='
  }
error Command failed with exit code 1.

I feel that the assertions are essential for ensuring trust in this benchmark, but I also kept in the logging because it's not very much output.

I'd love to put analogous verification in place for the foundry test as well, but I haven't yet been able to get that environment set up.

opened Jan 18, 2022 by feuGeneA 13
Closed

docs: specify that the RPC endpoint is HTTP/S

When https://github.com/gakonst/foundry/pull/1003 is merged Forge will support WebSocket and IPC endpoints which should (in theory, at least) significantly speed up forking, since instead of closing and re-opening the RPC at every request, we would keep the connection alive.

As a sidenote, would it make sense to try and compare with a WebSocket endpoint as well? IPC might be a bit too much.

opened Mar 30, 2022 by onbjerg 5
Closed

Streamline the Docker build process

null

opened Jan 27, 2022 by feuGeneA 4
Closed

fix: ganache simulation fails with out of gas

Discovered by @feuGeneA in https://github.com/mds1/convex-shutdown-simulation/pull/4, moving tracking of that issue here.

Ganache simulation fails with out of gas error, which @gnidan and @davidmurdoch are planning to look into. For reference, here's how much gas used is reported when simulating this transaction with various tools:

Gas usage at block 13,724,056:

  • Foundry: 15,515,282 (using the fix in https://github.com/gakonst/foundry/pull/524)
  • Hardhat: 15,344,483
  • Dapptools: 16,779,553 (I don't think this accounts for refunds)
  • Tenderly: 15,537,677 (not in this repo, but will check it manually using their simulator)
opened Jan 20, 2022 by mds1 4
Closed

Out of gas exception when running simulation on Ganache

The transaction runs out of gas (hits block limit of 30M) during simulation with Ganache (I am using Alchemy as a node provider). script output:

$  ./scripts/convex.ganache.ts
yarn run v1.22.15
Setting up Ganache...
  eth_chainId
  eth_chainId
  eth_call
  eth_accounts
  eth_sendTransaction

    Transaction: 0x22ba0b17256c047bf139d53b98a6cdbb8a1bee5ec10e1573883588c805e5c820
    Contract created: 0x324c828fbc98e722afd73ec91fbf4263eeccb0dc
    Gas usage: 64323
    Block number: 14121829
    Block time: Thu May 19 2022 18:26:28 GMT-0400 (Eastern Daylight Saving Time)

  eth_chainId
  eth_getTransactionReceipt
  eth_blockNumber
  eth_chainId
  eth_sendTransaction

    Transaction: 0xf9f9c5a0f511df85a01319364f0cfd157130c290eaf06fd89b263e43777a0245
    Contract created: 0xd62f3dfaf07eb471fbd4ab88bfe2c6c8a7dc8b3c
    Gas usage: 64323
    Block number: 14121830
    Block time: Thu May 19 2022 18:26:29 GMT-0400 (Eastern Daylight Saving Time)

  eth_chainId
  eth_getTransactionReceipt
  evm_addAccount
  personal_unlockAccount
setup-ganache: 3.101s

Simulating shutdown...
  eth_sendTransaction
  
    Transaction: 0x8617941537d4f6ddd9934752b93cbf7b335969f1c87956ccbfb110a018aeaaf9
    Gas usage: 30000000
    Block number: 14121831
    Block time: Thu May 19 2022 18:26:29 GMT-0400 (Eastern Daylight Saving Time)
    Runtime error: out of gas

I replicated the logic using Brownie with the same network parameters, but increased the block gas limit to 100M, and found it used around 60M gas:

Running 'scripts/sim.py::main'...
Executing system shutdown...
Transaction sent: 0x3007e01e625dd6e40d30890496ae5defc3206145de1636a7ee079f96b988d536
  Gas price: 0.0 gwei   Gas limit: 100000000   Nonce: 1
  Booster.shutdownSystem confirmed   Block: 14445963   Gas used: 60707716 (60.71%)

It would be great to know why my results differ from what's given in the readme.

opened May 19, 2022 by dtr0x 2
Closed

feat: update benchmarks

null

opened Mar 24, 2022 by mds1 2
Open

feat: look into websocket support and add websocket benchmarks

This sim relies on a lot of network requests, which are done over HTTPS. Foundry is adding websocket support, and if Hardhat and Ganache both support websockets as well we can add a separate table with websocket benchmarks

opened Mar 30, 2022 by mds1 0
Open

fix: hardcode `owner` address

Some simulations query the node for this, some hardcode the address, and some just overwrite the owner with a local account. For consistency, let's just hardcode the owner address (the from address used) in each simulation for now

opened Jan 31, 2022 by mds1 0
Open

ci: setup github actions

Ideally the CI will run the benchmarks and save results somewhere. However, @alcuadrado has mentioned the performance of GH runners may fluctuate, though this may only occur between jobs and not within the same job. Before relying on CI to report the benchmarks, let's perform a series of benchmarks locally and within a single CI job and ensure the relative performance between tools is similar in the two

opened Jan 20, 2022 by mds1 0
Open

feat: report benchmarks of each tool

For each tool, benchmark scripts should report

  • full execution time, i.e. including tool startup time
  • execution time of just the transaction simulation (not sure if this is possible for each tool)
  • gas used
  • some simple state verification, e.g. check logs or traces, or perhaps we just check this one manually for now?
opened Dec 7, 2021 by mds1 3

Contents

    cvxgrp Differentiable convex optimization layers
    CW-Huang "Convex Potential Flows: Universal Probability Distributions with Optimal Transport and Convex Optimization"
    RoanH An area maximisation game based on the idea of merging convex shapes.
    projectchicago ⛽ Tokenize gas on Ethereum with GasToken ⛽
    louisoutin Unofficial implementation of the paper: "Step on the Gas? A Better Approach for Recommending the Ethereum Gas Price"
    go-playground :hocho: Is a library that aids in graceful shutdown of a process/application
    emmanuelkehinde An android library that handles the closing of your app interactively.
    Finomnis Provides utility functions to perform a graceful shutdown on tokio-rs based services
    go-macaron Package method is a middleware that implements HTTP method override for Macaron.
    MyCryptoHQ EIP-1559 gas estimation library, using the estimation strategy of MyCrypto.
    MouinAlmasoodi Creates Water-Oil and Gas-Liquid relative permeability curves with interactive gas relative perm parameters. Outputs relative perm tables needed for reservoir simulators.
    NicolasPetton Elbank is a personal finances application for Emacs
    saymagic Annotation-triggered method call logging library.
    firefly-iii Firefly III: a personal finances manager
    jonatasbaldin Fin is an open source backend API to track personal finances, made with Go 💸
    harjot-oberai Material Shadows for android : A library for supporting convex material shadows
    matheusgadelha Self-supervision for Point Clouds using Approximate Convex Decompositions
    tuantran23012000 Solving Convex and Nonconvex Optimization Problems
    dgreenheck Open source mesh slicing/fracturing utility for Unity
    photonlines A Go web server with built in logging, tracing, health check, and graceful shutdown. It also includes a few demo applications showing the Go HTML temple functionality.
    udaya2899 Opinionated Go starter with gin for REST API, logrus for logging, viper for config with added graceful shutdown
    Share this repo

    Related Repos


    Miscellaneous
    5.5k
    Apache OpenWhisk is an open source serverless cloud platform
    apache OpenWhisk OpenWhisk is a serverless functions platform for building cloud applications. OpenWhisk offers a rich programming model for creating serverl
     
    Miscellaneous
    11
    Replaces twitter NFT idiocracy
    4ndv HexaGone HexaGone allows you to revert or customize twitter's new hexagonal avatars. It's a collection of a several userscripts, with different clip m
     
    Miscellaneous
    6
    replaces the nft avatars on twitter with subway jared
    virginteen replace-nft-avatars a chrome extension that replaces the nft avatars on twitter with subway jared to install Download this repo (Code > Download ZIP).
     
    Miscellaneous
    5
    Smart Contract Viewer for VS Code
    MetaplasiaTeam Contract Viewer English | 中文 Contract Viewer 是一个 VS Code 扩展，他可以帮你从区块链浏览器下载合约代码，只需要一个合约地址即可下载。 目前仅支持以太坊使用 Solidity 的智能合约，后续会支持更多类型。 快速开始 配置一个 API 在 Erh
     
    Miscellaneous
    5
    Video calling using WebRTC
    mehditeymorian webrtc-video-call This project is a video calling application using WebRTC technology. It contains minimum requirements to provide a group video call.
     
    Miscellaneous
    3
    A multipurpose bot, a clan bot, a all in one bot. The one bot u need for ur server origina...
    Tomato6966 Multipurpose-discord-bot A multipurpose bot, a clan bot, a all in one bot. The one bot u need for ur server originally made as Milrato discord Bot and
     
    Miscellaneous
    334
    A template for site builders and low-code tools.
    vercel Platforms Starter Kit The all-in-one starter kit for building platforms on Vercel. Introduction · Guide · Demo · Contributing Deploy Your Own Read the
     
    Miscellaneous
    152
    A Raycast/Alfred/Spotlight alternative
    ospfranco sol A Raycast/Alfred/Spotlight alternative Don't bother trying to run this, it's WIP, right now only the basic UI is there, no logic, there many bugs/
     
    Miscellaneous
    73
    Self hosted media tracker for movies, tv shows, video games, books and audiobooks
    bonukai MediaTracker · Self hosted platform for tracking movies, tv shows, video games, books and audiobooks, highly inspired by flox Demo https://mediatracke
     
    Miscellaneous
    52
    Everytime I come across good Github profiles I index them here
    championswimmer awesome-devs Everytime I come across good Github profiles I index them here NOTE: If you are on the github repo currently, go to the website 👇 to see
     
    Miscellaneous
    49
    Minimalist template for foundry projects
    ZeframLou Foundry template This is a template for a Foundry project. Installation To install with DappTools: dapp install [user]/[repo] To install with Foundry
     
    Miscellaneous
    45
    Log in the node terminal from the browser
    patak-dev vite-plugin-terminal Log in the node terminal from the browser Open a playground online in StackBlitz Install npm i -D vite-plugin-terminal Add plugin
     
    Miscellaneous
    43
    A simple web3 app for minting NFTs
    fireship-io Web3 - Full Tutorial The demo contains a basic web3 app and smart contract for minting NFTs. See it in action in the Web3 NFT Tutorial on YouTube. Fol
     
    Miscellaneous
    28
    A three.js component library for Svelte.
    grischaerbe A three.js component library for svelte. Index What is threlte? Getting started Concepts Interactivity Viewport Awareness Reactivity Conventions Refer
     
    Miscellaneous
    26
    Wordle Svelte Clone
    tayfunerbilen Wordle Svelte Clone Son zamanlarda popüler olan WORDLE uygulamasını svelte ile yapmaya çalıştım. Bu tarz acaba yapsam nasıl yapardım uygulamarı bana ç