Why Sponsor Oil? | source | all versions | oilshell.org

Oil 0.15.0 Quality

This is a supplement to the main release page.

Test Results

Spec Tests

• OSH Survey. Test OSH with existing shells, and compare their behavior.
  • OSH in C++. The progress of Oil's C++ translation.
• Oil Language. The legacy-free language.
  • Oil in C++. The progress of Oil's C++ translation.
• Stateful Tests. Tests that use pexpect.

Other Primary Suites

• Gold Tests. Compare OSH against bash (using implicit assertions, no golden output.)
• Wild Tests. Parse and translate thousands of shell scripts with OSH.
• Python Unit Tests.
• C++ Test Coverage measured by Clang.
  • Log Files
• Process Table. Are child processes in the right state for job control?

More

• Smoosh test suite (from mgree/smoosh):
  • smoosh | smoosh-hang
• parse-errors. A list of all parse errors.
  • parse-errors-osh-cpp. With the native binary.
• runtime-errors. A list of shell runtime errors.
• oil-runtime-errors. Oil language runtime errors.
• oil-large
• tea-large
• arena. Testing an invariant for the parser.
• osh-usage. Misc tests of the osh binary.
• oshc-deps. Tests for a subcommand in progress.
• How many processes does Oil start compared to other shells?
  • syscall/by-code | syscall/by-input
• ysh-prettify Tests. Test OSH to YSH translation.

Benchmarks

• Parser. How fast does OSH parse compared to other shells?
• Runtime. How fast does OSH run shell scripts?
• Compute. How fast does OSH run small programs without I/O?
• Build. How long does it take for end users to build Oil? How big is the resulting binary?
• Virtual Memory Baseline. How much memory do shells use at startup?
• mycpp. Compares Python and generated C++ on small examples.
• Memory Management Overhead. How much time do we spend managing memory, compared with the shell interpreter?
  • benchmarks/gc. Stats from the OS and our GC runtime.
  • benchmarks/gc-cachegrind. Stable measurements.

Metrics

• Lines of source, counted in different ways:
  • overview. The whole Oil repo organized by type of source file.
  • for-translation. An overview of the "compiler engineer" project.
  • osh-cloc. OSH and common libraries, as measured by the cloc tool.
• Generated C++ code
  • oil-cpp. The C++ code in the oils-for-unix tarball.
  • preprocessed. How much code is passed to the compiler?
    • cxx-dbg, cxx-opt
  • Binary code size reported by Bloaty. How much code is output by the compiler?
    • overview, symbols

Source Code

These files may help you understand how Oil is implemented, i.e. with domain-specific languages and code generation.

• _gen/frontend/id_kind.asdl_c.h. A list of language elements, used in the lexer and in multiple parsers and evaluators.
• The regex-based lexer uses two stages of code generation:
  • frontend/lexer_def.py | _build/tmp/frontend/match.re2c.txt | _gen/frontend/match.re2c.h
• frontend/syntax.asdl. The syntax tree for OSH and Oil.
• oil_lang/grammar.pgen2. The expression grammar for Oil. In contrast, the OSH parsers are hand-written.

Also see the oilshell/oil repository.

Old

These links describe the CPython / "OVM" build, which should become the "experimental" version of Oil.

OPy / OVM Metrics

• Lines of dependencies:
  • pydeps. Oil code plus the Python standard library.
  • nativedeps. Oil code plus a slice of CPython.
• Bytecode Metrics
  • overview - Compare OPy vs. CPython.
  • oil-with-opy - Oil compiled with OPy.
  • oil-with-cpython - Oil compiled with CPython (for comparison).
  • src-bin-ratio-with-opy - How big is the compiled output?
• OVM / CPython
  • overview - An analysis of GCC's compilation of OVM (a subset of CPython). Bloaty provides the underlying data.
  • cpython-defs/overview - We try to ship as little of CPython as possible, and this is what's left.