spec test index / oilshell.org
| status | dash | bash | mksh | zsh | osh | |
| pass | 27 | 32 | 27 | 30 | 33 | |
| ok | 3 | 2 | 4 | 0 | 0 | |
| N-I | 1 | 0 | 0 | 0 | 0 | |
| BUG | 4 | 1 | 4 | 5 | 0 | |
| FAIL | 0 | 0 | 0 | 0 | 2 | |
| total | 35 | 35 | 35 | 35 | 35 | |
| case | dash | bash | mksh | zsh | osh | description |
| 0 | pass | pass | pass | pass | pass | exec builtin |
| 1 | pass | pass | pass | pass | pass | exec builtin with redirects |
| 2 | pass | pass | pass | pass | pass | exec builtin with here doc |
| 3 | BUG | pass | pass | pass | pass | exec builtin accepts -- |
| details | ||||||
| 4 | BUG | pass | BUG | pass | pass | exec -- 2>&1 |
| details | details | |||||
| 5 | pass | pass | pass | pass | pass | cd and $PWD |
| 6 | BUG | pass | BUG | pass | FAIL | cd BAD/.. |
| details | details | details | ||||
| 7 | pass | pass | BUG | BUG | pass | $OLDPWD |
| details | details | |||||
| 8 | pass | pass | pass | pass | pass | pwd |
| 9 | pass | pass | pass | pass | pass | pwd after cd .. |
| 10 | pass | pass | pass | pass | pass | pwd with symlink and -P |
| 11 | pass | pass | pass | pass | pass | setting $PWD doesn't affect the value of 'pwd' builtin |
| 12 | pass | pass | pass | pass | pass | unset PWD; then pwd |
| 13 | pass | pass | pass | pass | pass | 'unset PWD; pwd' before any cd (tickles a rare corner case) |
| 14 | pass | pass | pass | pass | pass | lie about PWD; pwd before any cd |
| 15 | pass | pass | ok | pass | pass | remove pwd dir |
| details | ||||||
| 16 | pass | pass | ok | pass | pass | pwd in symlinked dir on shell initialization |
| details | ||||||
| 17 | pass | pass | pass | pass | pass | Test the current directory after 'cd ..' involving symlinks |
| 18 | pass | pass | pass | pass | pass | cd with no arguments |
| 19 | ok | pass | ok | pass | pass | cd to nonexistent dir |
| details | details | |||||
| 20 | pass | pass | pass | pass | pass | cd away from dir that was deleted |
| 21 | pass | pass | pass | pass | pass | cd permits double bare dash |
| 22 | pass | pass | pass | pass | pass | cd to symlink with -L and -P |
| 23 | pass | pass | pass | pass | pass | cd to relative path with -L and -P |
| 24 | pass | pass | pass | pass | pass | Exit out of function |
| 25 | ok | ok | pass | BUG | pass | Exit builtin with invalid arg |
| details | details | details | ||||
| 26 | BUG | BUG | ok | BUG | pass | Exit builtin with too many args |
| details | details | details | details | |||
| 27 | N-I | pass | pass | BUG | pass | time with brace group argument |
| details | details | |||||
| 28 | pass | pass | pass | pass | pass | time pipeline |
| 29 | pass | pass | pass | pass | pass | shift |
| 30 | ok | pass | pass | pass | pass | Shifting too far |
| details | ||||||
| 31 | pass | ok | BUG | BUG | pass | Invalid shift argument |
| details | details | details | ||||
| 32 | pass | pass | pass | pass | pass | get umask |
| 33 | pass | pass | pass | pass | pass | set umask in octal |
| 34 | pass | pass | pass | pass | FAIL | set umask symbolically |
| details |
149 passed, 9 OK, 1 not implemented, 14 BUG, 2 failed, 0 timeouts, 0 cases skipped 2 failed under osh
| dash | 3 exec builtin accepts -- stdout: stderr: dash: 1: exec: --: not found |
| dash | 4 exec -- 2>&1 stdout: stderr: dash: 1: exec: --: not found |
| mksh | 4 exec -- 2>&1 stdout: stderr: |
| dash | 6 cd BAD/.. stdout: status=0stderr: |
| mksh | 6 cd BAD/.. stdout: status=0stderr: |
| osh | 6 cd BAD/.. [osh stdout] Expected 'status=1\n', got 'status=0\n' stdout: status=0stderr: |
| mksh | 7 $OLDPWD stdout: old: / /stderr: |
| zsh | 7 $OLDPWD stdout: old: / OLDPWD=/stderr: |
| mksh | 15 remove pwd dir stdout: /tmp/oil-spec-test/pwd status=0 status=1stderr: mksh: <stdin>[7]: pwd: can't determine current directory: No such file or directory |
| mksh | 16 pwd in symlinked dir on shell initialization stdout: target targetstderr: |
| dash | 19 cd to nonexistent dir stdout: status=2stderr: dash: 1: cd: can't cd to /nonexistent/dir |
| mksh | 19 cd to nonexistent dir stdout: status=2stderr: mksh: <stdin>[1]: cd: /nonexistent/dir: No such file or directory |
| dash | 25 Exit builtin with invalid arg stdout: stderr: dash: 1: exit: Illegal number: invalid |
| bash | 25 Exit builtin with invalid arg stdout: stderr: bash: line 1: exit: invalid: numeric argument required |
| zsh | 25 Exit builtin with invalid arg stdout: stderr: |
| dash | 26 Exit builtin with too many args stdout: stderr: |
| bash | 26 Exit builtin with too many args stdout: status=1stderr: bash: line 1: exit: too many arguments |
| mksh | 26 Exit builtin with too many args stdout: stderr: mksh: <stdin>[1]: exit: too many arguments |
| zsh | 26 Exit builtin with too many args stdout: status=1stderr: exit: too many arguments |
| dash | 27 time with brace group argument stdout: stderr: time: cannot run {: No such file or directory
Command exited with non-zero status 127
0.00user 0.00system 0:00.00elapsed ?%CPU (0avgtext+0avgdata 1244maxresident)k
0inputs+0outputs (0major+29minor)pagefaults 0swaps
dash: 7: Syntax error: "}" unexpected
|
| zsh | 27 time with brace group argument stdout: result=1stderr: |
| dash | 30 Shifting too far stdout: stderr: dash: 2: shift: can't shift that many |
| bash | 31 Invalid shift argument stdout: stderr: bash: line 1: shift: ZZZ: numeric argument required |
| mksh | 31 Invalid shift argument stdout: stderr: |
| zsh | 31 Invalid shift argument stdout: stderr: |
| osh | 34 set umask symbolically [osh stdout] Expected '664\n644\n', got '664\n664\n' [osh stderr] Expected u'', got "osh warning: umask with symbolic input isn't implemented\n" stdout: 664 664stderr: osh warning: umask with symbolic input isn't implemented |