Repository navigation
GNU 9.12 behaviour specs for 41 utilities, runnable against uutils (1,418 cases) #16467
emirmrkaljevic
started this conversation in
Show and tell
Replies: 1 comment 1 reply
|
thanks, i appreciate it! |
1 reply
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
Hi, I've been sending small fixes here over the last few weeks (mostly error paths in
env,readlink,ptx,dircolors,csplitand friends). They came out of a tool I wrote, behave, which records how GNU behaves (stdout, stderr, exit code) and replays the same cases against another binary.The recordings are plain YAML in the repo, one directory per utility: https://github.com/emirmrkaljevic/behave/tree/main/examples . Most were recorded from GNU coreutils 9.12, a few early ones from 9.7. In case they are useful to anyone working on a utility, this is how the 0.12.0 release scores against them on Linux x86_64 (
--help/--versioncases excluded):In total 1,135 of 1,418 cases match exactly, and 1,327 of 1,418 if stderr wording is ignored. Many of the stderr differences are clap error messages and quoting ('x' vs ‘x’). Some of the rest are already fixed on
mainor tracked (for exampledircolorswithTERM=dumbin #14408,ptxin #15864 and #15406). The ones with the most stdout/exit differences in 0.12.0 areptx,pr,dircolorsandenv.To run one against your own build:
go install github.com/emirmrkaljevic/behave/cmd/behave@latest git clone https://github.com/emirmrkaljevic/behave ln -s /path/to/coreutils ./seq # the multicall binary picks the utility from argv[0] behave diff behave/examples/seq --impl ./seq --skip-tag metaEach failing case prints the command, the expected output and the diff, so it is quick to turn into a test.
I'll keep filing real bugs one issue + PR at a time as before and skip anything that looks intentional. If there are differences you consider by design (or categories you'd rather not see reported), tell me and I'll mark them in the specs.
All reactions