Skip to content

Latest commit

 

History

History
194 lines (137 loc) · 8.44 KB

README-dev.md

File metadata and controls

194 lines (137 loc) · 8.44 KB
Raw

Mina

Mina is a new cryptocurrency protocol with a lightweight, constant-sized blockchain.

If you haven't seen it yet, CONTRIBUTING.md has information about our development process and how to contribute. If you just want to build Mina, this is the right file!

Building Mina

Building Mina can be slightly involved. There are many C library dependencies that need to be present in the system, as well as some OCaml-specific setup.

If you are already a Nix user, or are comfortable installing Nix, it can be an easy way to build Mina locally. See nix/README.md for more information and instructions.

Currently, Mina builds/runs on Linux & macOS. MacOS may have some issues that you can track here.

The short version:

  1. Start with Ubuntu 18 or run it in a virtual machine
  2. Set github repos to pull and push over ssh: git config --global url.ssh://[email protected]/.insteadOf https://github.com/
    • To push branches to repos in the MinaProtocol or o1-labs organisations, you must complete this step. These repositories do not accept the password authentication used by the https URLs.
  3. Pull in our submodules: git submodule update --init --recursive
  4. Run git config --local --add submodule.recurse true

Developer Setup (Docker)

You can build Mina using Docker. This should work in any dev environment. Refer to /dev.

Developer Setup (MacOS)

  • Invoke make macos-setup
    • If this is your first time using OCaml, be sure to run eval $(opam config env)
  • Invoke rustup toolchain install 1.58.1
  • Invoke make build
  • Jump to customizing your editor for autocomplete
  • Note: If you are seeing conf-openssl install errors, try running export PKG_CONFIG_PATH=$(brew --prefix [email protected])/lib/pkgconfig and try opam switch import opam.export again.

Developer Setup (Linux)

Building

Mina has a variety of opam and system dependencies.

To get all the opam dependencies you need, you run opam switch import opam.export.

NOTE: The switch provides a dune_wrapper binary that you can use instead of dune, and will fail early if your switch becomes out of sync with the opam.export file.

Some of our dependencies aren't taken from opam, and aren't integrated with dune, so you need to add them manually, by running scripts/pin-external-packages.sh.

There are a variety of C libraries we expect to be available in the system. These are also listed in the dockerfiles. Unlike most of the C libraries, which are installed using apt in the dockerfiles, the libraries for RocksDB are automatically installed when building Mina via a dune rule in the library ocaml-rocksdb.

Setup Docker CE on Ubuntu

Customizing your dev environment for autocomplete/merlin

  • If you use vim, add this snippet in your vimrc to use merlin. (REMEMBER to change the HOME directory to match yours)
let s:ocamlmerlin="/Users/USERNAME/.opam/4.07/share/merlin"
execute "set rtp+=".s:ocamlmerlin."/vim"
execute "set rtp+=".s:ocamlmerlin."/vimbufsync"
let g:syntastic_ocaml_checkers=['merlin']

  • In your home directory opam init

  • In this shell, eval $(opam config env)

  • Now /usr/bin/opam install merlin ocp-indent core async ppx_jane ppx_deriving (everything we depend on, that you want autocompletes for) for doc reasons

  • Make sure you have au FileType ocaml set omnifunc=merlin#Complete in your vimrc

  • Install an auto-completer (such as YouCompleteMe) and a syntastic (such syntastic or ALE)

  • If you use vscode, you might like this extension

  • If you use emacs, besides the opam packages mentioned above, also install tuareg, and add the following to your .emacs file:

(let ((opam-share (ignore-errors (car (process-lines "opam" "config" "var" "share")))))
  (when (and opam-share (file-directory-p opam-share))
    ;; Register Merlin
    (add-to-list 'load-path (expand-file-name "emacs/site-lisp" opam-share))
    (load "tuareg-site-file")
    (autoload 'merlin-mode "merlin" nil t nil)
    ;; Automatically start it in OCaml buffers
    (add-hook 'tuareg-mode-hook 'merlin-mode t)
    (add-hook 'caml-mode-hook 'merlin-mode t)))

Emacs has a built-in autocomplete, via M-x completion-at-point, or simply M-tab. There are other Emacs autocompletion packages; see Emacs from scratch.

Using the Makefile

The makefile contains phony targets for all the common tasks that need to be done. It also knows how to use Docker automatically.

These are the most important make targets:

  • build: build everything
  • libp2p_helper: build the libp2p helper
  • reformat: automatically use ocamlformat to reformat the source files (use it if the hook fails during a commit)

We use the dune buildsystem for our OCaml code.

Steps for adding a new dependency

Rarely, you may edit one of our forked opam-pinned packages, or add a new system dependency (like libsodium). Some of the pinned packages are git submodules, others inhabit the git Mina repository.

If an existing pinned package is updated, either in the Mina repository or in the the submodule's repository, it will be automatically re-pinned in CI.

If you add a new package in the Mina repository or as a submodule, you must do all of the following:

  1. Update scripts/macos-setup.sh with the required commands for Darwin systems
  2. Update dockerfiles/stages/ with the required packages

Common dune tasks

To run unit tests for a single library, do dune runtest lib/$LIBNAME.

You might see a build error like this:

Error: Files src/lib/mina_base/mina_base.objs/account.cmx
       and src/lib/mina_base/mina_base.objs/token_id.cmx
       make inconsistent assumptions over implementation Crypto_params

You can work around it with rm -r src/_build/default/src/$OFFENDING_PATH and a rebuild. Here, the offending path is src/lib/mina_base/mina_base.objs.

Overriding Genesis Constants

Mina genesis constants consists of constants for the consensus algorithm, sizes for various data structures like transaction pool, scan state, ledger etc. All the constants can be set at compile-time. A subset of the compile-time constants can be overriden when generating the genesis state using runtime_genesis_ledger.exe, and a subset of those can again be overridden at runtime by passing the new values to the daemon.

The constants at compile-time are set for different configurations using optional compilation. This is how integration tests/builds with multiple configurations are run. Currently some of these constants (defined here) cannot be changed after building and would require creating a new build profile (*.mlh files) for any change in the values.

1. Constants that can be overridden when generating the genesis state are:

  • k (consensus constant)
  • delta (consensus constant)
  • genesis_state_timestamp
  • transaction pool max size

To override the above listed constants, pass a json file to runtime_genesis_ledger.exe with the format:

{
  "k": 10,
  "delta": 3,
  "txpool_max_size": 3000,
  "genesis_state_timestamp": "2020-04-20 11:00:00-07:00"
}

The exe will then package the overriden constants along with the genesis ledger and the genesis proof for the daemon to consume.

2. Constants that can be overriden at runtime are:

  • genesis_state_timestamp
  • transaction pool max size

To do this, pass a json file to the daemon using the flag genesis-constants with the format:

{
  "txpool_max_size": 3000,
  "genesis_state_timestamp": "2020-04-20 11:00:00-07:00"
}

The daemon logs should reflect these changes. Also, mina client status displays some of the constants.