From @Ovid

t/spec/S29-conversions/ord_and_chr.rakudo fails with​:

  t/spec/S29-conversions/ord_and_chr.rakudo (Wstat​: 10 Tests​: 170 Failed​: 0)
  Parse errors​: Bad plan. You planned 240 tests but ran 170.

However, it runs to completion with​:

  ./perl6 t/spec/S29-conversions/ord_and_chr.rakudo fails with​:

The problem is that, when running it as a test, it appears to hang between these two for loops, and then exits​:

  for @​maps -> $char, $code {
  my $descr = "\\{$code}{$code >= 32 ?? " == '{$char}'" !! ""}";
  is ord($char), $code, "ord() works for $descr";
  is chr($code), $char, "chr() works for $descr";
  }

  for 0..31 -> $code {
  my $char = chr($code);
  is ord($char), $code, "ord(chr($code)) is $code";
  }

In testing, I put "say 1" between the two loops and the test ran to completion.

Cheers,
Ovid
--
Buy the book - http://www.oreilly.com/catalog/perlhks/
Tech blog - http://use.perl.org/~Ovid/journal/
Twitter - http://twitter.com/OvidPerl
Official Perl 6 Wiki - http://www.perlfoundation.org/perl6

From @pmichaud

On Wed, Nov 12, 2008 at 03​:35​:08PM -0800, curtis_ovid_poe@​yahoo.com (via RT) wrote​:

t/spec/S29-conversions/ord_and_chr.rakudo fails with​:

t/spec/S29-conversions/ord_and_chr.rakudo (Wstat​: 10 Tests​: 170 Failed​: 0)
Parse errors​: Bad plan. You planned 240 tests but ran 170.

However, it runs to completion with​:

./perl6 t/spec/S29-conversions/ord_and_chr.rakudo fails with​:

This appears to be one of our heisenbugs -- it occurs in some
revisions but not in others.

For example in r32625 I get a similar situation with
t/spec/S03-operators/assign.t -- running it with
"make t/spec/S03-operators/assign.t" produces a failure in tests 246-306,
while running it directly from the command line works fine.
In other revisions it seems to work properly.

In contrast, for r32625 I don't see the ord_and_chr.t failure you
have, although I have seen it in other revisions. So, when reporting
these sorts of bugs it really helps to know what svn revision you're
working from.

In the assign.t case, it appears this may be related to the fact that
the test harness sets the PERL6LIB environment variable​:

  # works
  $ ./parrot perl6.pbc t/spec/S03-operators/assign.rakudo

  # fails
  $ PERL6LIB=$PWD/t/01-sanity ./parrot perl6.pbc t/spec/S03-operators/assign.rakudo
  1..306
  ok 1 - # SKIP List assignment
  ok 2 - # SKIP List assignment
  ok 3 - # SKIP List assignment
  [...]
  ok 242 - # SKIP unknown reasons
  ok 243 - # SKIP unknown reasons
  ok 244 - # SKIP unknown reasons
  ok 245 - # SKIP unknown reasons
  GC​: error obj 0xb7790198 () has properties
  *** glibc detected *** ./parrot​: corrupted double-linked list​: 0x08d06200 ***
  ======= Backtrace​: =========
  /lib/tls/i686/cmov/libc.so.6[0xb76ae149]
  /lib/tls/i686/cmov/libc.so.6[0xb76afedd]
  /lib/tls/i686/cmov/libc.so.6(__libc_calloc+0xcf)[0xb76b19ff]
  /home/pmichaud/parrot/trunk/blib/lib/libparrot.so.0.8.0[0xb7b2e3e5]

Again, this is all with r32625, YMMV with other revisions (and please
report whatever other clues you may find).

Thanks!

Pm

The RT System itself - Status changed from 'new' to 'open'

From publiustemp-perl6compiler2@yahoo.com

--- On Thu, 13/11/08, Patrick R. Michaud <pmichaud@​pobox.com> wrote​:

Again, this is all with r32625, YMMV with other revisions
(and please
report whatever other clues you may find).

Ah, sorry. I should have known better :)

r32580

$ uname -a
Darwin curtis-poes-computer-2.local 9.5.1 Darwin Kernel Version 9.5.1​: Fri Sep 19 16​:19​:24 PDT 2008; root​:xnu-1228.8.30~1/RELEASE_I386 i386

Now this test passes (r32629), but the Perl 6 test suite is still failing. Now, however, I can't tell which test fails. The output was confusing enough to me that I've copied it to a file and attached it (teeing the spectest rusults to a file was spectacularly disappointing. It doesn't play well with tee).

Cheers,
Ovid

From publiustemp-perl6compiler2@yahoo.com

perl6 $ make spectest
../../parrot perl6.pbc --target=pir --output=Test.pir Test.pm
cd t/spec && svn up
U S03-junctions/misc.t
U S03-operators/ternary.t
A integration/real-strings.t
Updated to revision 23000.
perl t/harness --fudge --keep-exit-code --jobs --tests-from-file=t/spectest.data
t/spec/S02-builtin_data_types/array_extending.t ................ ok
t/spec/S02-builtin_data_types/anon_block.rakudo ................ ok
===( 45;6 0/? 1/45 0/? )=======================================Use of uninitialized value
Use of uninitialized value
Use of uninitialized value
Use of uninitialized value
Use of uninitialized value
Use of uninitialized value
Use of uninitialized value
Use of uninitialized value
t/spec/S02-builtin_data_types/array_ref.rakudo ................. ok
===( 90;7 1/97 0/? 0/? )=======================================Use of uninitialized value
Use of uninitialized value
Use of uninitialized value
Use of uninitialized value
Use of uninitialized value
Use of uninitialized value
Use of uninitialized value
Use of uninitialized value
Use of uninitialized value
Use of uninitialized value
Use of uninitialized value
Use of uninitialized value
Use of uninitialized value
t/spec/S02-builtin_data_types/array.rakudo ..................... ok
t/spec/S02-builtin_data_types/bool.t ........................... ok
t/spec/S02-builtin_data_types/catch_type_cast_mismatch.rakudo .. ok
t/spec/S02-builtin_data_types/assigning-refs.rakudo ............ ok
t/spec/S02-builtin_data_types/flattening.rakudo ................ ok
===( 269;14 0/? 1/32 0/? )======================================Use of uninitialized value
Use of uninitialized value
Use of uninitialized value
Use of uninitialized value
t/spec/S02-builtin_data_types/hash_ref.rakudo .................. ok
===( 301;17 1/58 0/? 0/? )======================================Use of uninitialized value
Use of uninitialized value
Use of uninitialized value
Use of uninitialized value
t/spec/S02-builtin_data_types/hash.rakudo ...................... ok
t/spec/S02-builtin_data_types/multi_dimensional_array.rakudo ... ok
t/spec/S02-builtin_data_types/nested_pairs.t ................... ok
t/spec/S02-builtin_data_types/nested_arrays.t .................. ok
t/spec/S02-builtin_data_types/mixed_multi_dimensional.rakudo ... ok
===( 495;24 0/? 0/? 1/8 )========================================Use of uninitialized value
t/spec/S02-builtin_data_types/subscripts_and_context.rakudo .... ok
t/spec/S02-builtin_data_types/num.rakudo ....................... ok
t/spec/S02-builtin_data_types/type.rakudo ...................... ok
t/spec/S02-literals/array-interpolation.rakudo ................. ok
===( 590;29 1/79 0/? 0/? )======================================Undefined value shifted from empty range
t/spec/S02-builtin_data_types/range.rakudo ..................... ok
t/spec/S02-literals/hash-interpolation.rakudo .................. ok
t/spec/S02-literals/hex_chars.t ................................ ok
t/spec/S02-literals/char-by-number.rakudo ...................... ok
t/spec/S02-literals/listquote-whitespace.rakudo ................ ok
t/spec/S02-literals/pair-boolean.t ............................. ok
===( 741;36 0/? 1/14 0/? )======================================Use of uninitialized value
Use of uninitialized value
t/spec/S02-literals/listquote.rakudo ........................... ok
t/spec/S02-literals/autoref.rakudo ............................. ok
t/spec/S02-literals/pairs.rakudo ............................... ok
t/spec/S02-literals/string-interpolation.t ..................... ok
===( 860;46 1/135 0/? 0/? )====================================Use of uninitialized value
t/spec/S02-literals/quoting.rakudo ............................. ok
t/spec/S02-magicals/dollar-underscore.t ........................ ok
t/spec/S02-literals/underscores.t .............................. ok
t/spec/S02-magicals/dollar_bang.rakudo ......................... ok
t/spec/S02-names_and_variables/varnames.t ...................... ok
t/spec/S02-names_and_variables/fmt.rakudo ...................... ok
t/spec/S02-polymorphic_types/subset-code.t ..................... ok
t/spec/S02-polymorphic_types/subset-range.t .................... ok
t/spec/S02-whitespace_and_comments/one-pass-parsing.t .......... ok
t/spec/S02-whitespace_and_comments/minimal-whitespace.t ........ ok
t/spec/S02-whitespace_and_comments/pod-in-multi-line-exprs.t ... ok
t/spec/S02-literals/radix.rakudo ............................... ok
t/spec/S03-junctions/boolean-context.rakudo .................... ok
t/spec/S03-operators/assign-is-not-binding.t ................... ok
t/spec/S03-junctions/misc.rakudo ............................... ok
===( 1396;70 1/192 0/? 0/? )====================================Use of uninitialized value
Use of uninitialized value
Use of uninitialized value
Use of uninitialized value
Use of uninitialized value
Use of uninitialized value
Use of uninitialized value
Use of uninitialized value
Use of uninitialized value
Use of uninitialized value
Use of uninitialized value
Use of uninitialized value
Use of uninitialized value
Use of uninitialized value
Use of uninitialized value
Use of uninitialized value
Use of uninitialized value
Use of uninitialized value
Use of uninitialized value
Use of uninitialized value
Use of uninitialized value
Use of uninitialized value
Use of uninitialized value
Use of uninitialized value
t/spec/S03-operators/arith.rakudo .............................. ok
t/spec/S03-operators/autovivification.rakudo ................... ok
t/spec/S03-operators/autoincrement.t ........................... ok
t/spec/S03-operators/binding-arrays.rakudo ..................... ok
t/spec/S03-operators/binding-hashes.rakudo ..................... ok
===( 1738;84 1/306 0/? 0/? )====================================Use of uninitialized value
===( 1750;84 12/306 1/28 0/? )==================================Use of uninitialized value
Use of uninitialized value
Use of uninitialized value
Use of uninitialized value
Use of uninitialized value
Use of uninitialized value
Use of uninitialized value
t/spec/S03-operators/binding-scalars.rakudo .................... ok
t/spec/S03-operators/assign.rakudo ............................. ok
t/spec/S03-operators/bit.rakudo ................................ ok
t/spec/S03-operators/chained-declarators.rakudo ................ ok
t/spec/S03-operators/comparison.t .............................. ok
t/spec/S03-operators/cross-metaop.rakudo ....................... ok
===( 2129;89 0/? 0/? 1/15 )======================================Use of uninitialized value
Use of uninitialized value
Use of uninitialized value
t/spec/S03-operators/equality.t ................................ ok
t/spec/S03-operators/context.rakudo ............................ ok
===( 2179;94 1/87 0/? 0/? )======================================Use of uninitialized value
Use of uninitialized value
Use of uninitialized value
Use of uninitialized value
Use of uninitialized value
t/spec/S03-operators/context-forcers.rakudo .................... ok
t/spec/S03-operators/not.rakudo ................................ ok
t/spec/S03-operators/increment.rakudo .......................... ok
===( 2320;98 0/? 1/35 0/? )======================================Use of uninitialized value
Use of uninitialized value
Use of uninitialized value
Use of uninitialized value
Use of uninitialized value
Use of uninitialized value
Use of uninitialized value
Use of uninitialized value
Use of uninitialized value
t/spec/S03-operators/numeric-context.rakudo .................... ok
===( 2355;98 1/49 0/? 0/? )======================================Use of uninitialized value
Use of uninitialized value
Use of uninitialized value
t/spec/S03-operators/misc.rakudo ............................... ok
t/spec/S03-operators/precedence.rakudo ......................... ok
t/spec/S03-operators/relational.t .............................. ok
t/spec/S03-operators/repeat.rakudo ............................. ok
t/spec/S03-operators/range.rakudo .............................. ok
t/spec/S03-operators/spaceship-and-containers.t ................ ok
t/spec/S03-operators/short-circuit.rakudo ...................... ok
t/spec/S03-operators/ternary.rakudo ............................ ok
t/spec/S03-operators/true.t .................................... ok
t/spec/S03-operators/smartmatch.rakudo ......................... ok
t/spec/S04-declarations/implicit-parameter.rakudo .............. ok
t/spec/S04-declarations/multiple.rakudo ........................ ok
t/spec/S04-statement-modifiers/for.rakudo ...................... ok
t/spec/S04-declarations/my.rakudo .............................. ok
t/spec/S04-statement-modifiers/given.rakudo .................... ok
t/spec/S03-operators/value_equivalence.rakudo .................. ok
t/spec/S04-statement-modifiers/unless.t ........................ ok
t/spec/S04-statement-modifiers/until.rakudo .................... ok
t/spec/S04-statement-modifiers/if.rakudo ....................... ok
t/spec/S04-statement-modifiers/while.rakudo .................... ok
t/spec/S04-statement-modifiers/values_in_bool_context.t ........ ok
t/spec/S04-statements/for-scope.rakudo ......................... ok
t/spec/S04-statements/do.rakudo ................................ ok
t/spec/S04-statements/for_with_only_one_item.t ................. ok
t/spec/S04-statements/gather.rakudo ............................ ok
t/spec/S04-statements/given.rakudo ............................. ok
t/spec/S04-statements/for.rakudo ............................... ok
t/spec/S04-statements/loop.rakudo .............................. ok
t/spec/S04-statements/map-and-sort-in-for.t .................... ok
t/spec/S04-statements/if.rakudo ................................ ok
t/spec/S04-statements/no-implicit-block.rakudo ................. ok
t/spec/S04-statements/next.rakudo .............................. ok
t/spec/S04-statements/repeat.rakudo ............................ ok
t/spec/S04-statements/return.rakudo ............................ ok
t/spec/S04-statements/terminator.t ............................. ok
t/spec/S04-statements/until.t .................................. ok
t/spec/S04-statements/unless.t ................................. ok
t/spec/S04-statements/try.rakudo ............................... ok
t/spec/S05-grammar/namespace.rakudo ............................ ok
t/spec/S04-statements/while.t .................................. ok
t/spec/S05-match/arrayhash.t ................................... ok
t/spec/S05-match/blocks.rakudo ................................. ok
t/spec/S05-match/non-capturing.t ............................... ok
t/spec/S05-metachars/newline.rakudo ............................ ok
t/spec/S05-metasyntax/changed.t ................................ ok
t/spec/S05-metasyntax/charset.t ................................ ok
===( 3287;166 0/? 0/? 1/14 )=====================================Use of uninitialized value
t/spec/S05-metasyntax/regex.rakudo ............................. ok
t/spec/S05-metasyntax/single-quotes.t .......................... ok
t/spec/S05-metasyntax/unknown.t ................................ ok
t/spec/S05-modifier/ignorecase.rakudo .......................... ok
t/spec/S05-substitution/match.rakudo ........................... ok
t/spec/S05-substitution/subst.rakudo ........................... ok
t/spec/S05-mass/stdrules.t ..................................... ok
t/spec/S05-transliteration/with-closure.t ...................... ok
t/spec/S05-transliteration/trans.rakudo ........................ ok
t/spec/S06-advanced_subroutine_features/recurse.rakudo ......... ok
t/spec/S06-multi/syntax.t ...................................... ok
t/spec/S06-multi/type-based.rakudo ............................. ok
t/spec/S06-signature/code.t .................................... ok
===( 3636;191 0/? 1/63 0/? )=====================================Use of uninitialized value
Use of uninitialized value
Use of uninitialized value
t/spec/S06-advanced_subroutine_features/return.rakudo .......... ok
t/spec/S06-signature/mixed-placeholders.t ...................... ok
t/spec/S06-signature/named-placeholders.t ...................... ok
t/spec/S06-signature/positional-placeholders.t ................. ok
t/spec/S06-signature/slurpy-placeholders.t ..................... ok
t/spec/S06-signature/sub-ref.rakudo ............................ ok
t/spec/S06-signature/named-parameters.rakudo ................... ok
t/spec/S06-traits/is-copy.t .................................... ok
t/spec/S06-signature/type-capture.t ............................ ok
t/spec/S06-traits/is-rw.rakudo ................................. ok
t/spec/S06-traits/misc.rakudo .................................. ok
t/spec/S12-attributes/class.t .................................. ok
t/spec/S11-modules/export.t .................................... ok
t/spec/S12-class/anonymous.t ................................... ok
t/spec/S12-attributes/delegation.rakudo ........................ ok
t/spec/S12-class/basic.rakudo .................................. ok
===( 3953;213 0/? 0/? 1/2 )=======================================src/inter_call.c​:390​: failed assertion 'PObj_is_PMC_TEST(sig_pmc)'
Backtrace - Obtained 32 stack frames (max trace depth is 32).
  Parrot_confess
  Parrot_confess
  Parrot_init_arg_op
  Parrot_init_ret_nci
  Parrot_mmd_add_multi_list_from_c_args
  Parrot_mmd_add_multi_list_from_c_args
  Parrot_NCI_invoke
  Parrot_invokecc_p
  dod_register_pmc
  interpinfo_s
  enable_event_checking
  Parrot_runops_fromc
  Parrot_runops_fromc_args
  Parrot_ex_throw_from_c
  Parrot_ex_throw_from_c_args
  Parrot_class_lookup
  Parrot_class_lookup
  Parrot_Capture_ro_unshift_string
  Parrot_Class_init_pmc
  pmc_new_init
  Parrot_newclass_p_p
  dod_register_pmc
  interpinfo_s
  enable_event_checking
  Parrot_runops_fromc
  Parrot_runops_fromc_args
  Parrot_ex_throw_from_c
  Parrot_ex_throw_from_c_args
  Parrot_class_lookup
  Parrot_class_lookup
  Parrot_Capture_ro_unshift_string
  Parrot_Class_init_pmc
t/spec/S12-class/declaration-order.t ........................... All 2 subtests passed
t/spec/S12-class/attributes.rakudo ............................. ok
t/spec/S12-class/inheritance-class-methods.t ................... ok
t/spec/S12-class/instantiate.t ................................. ok
t/spec/S12-class/is_also_instead.rakudo ........................ ok
t/spec/S12-class/namespaced.t .................................. ok
t/spec/S12-class/parent_attributes.t ........................... ok
t/spec/S12-class/inheritance.rakudo ............................ ok
t/spec/S12-enums/anonymous.t ................................... ok
t/spec/S12-enums/as-role.t ..................................... ok
t/spec/S12-enums/basic.rakudo .................................. ok
t/spec/S12-introspection/can.t ................................. ok
t/spec/S12-methods/indirect_notation.rakudo .................... ok
t/spec/S12-methods/calling_syntax.t ............................ ok
t/spec/S12-methods/topic.t ..................................... ok
t/spec/S12-methods/what.rakudo ................................. ok
t/spec/S12-methods/instance.rakudo ............................. ok
t/spec/S12-role/attributes.rakudo .............................. ok
t/spec/S12-role/composition.t .................................. ok
t/spec/S05-mass/rx.rakudo ...................................... ok
t/spec/S12-subset/multi-dispatch.rakudo ........................ ok
t/spec/S12-role/mixin.t ........................................ ok
t/spec/S16-io/say.t ............................................ ok
t/spec/S16-filehandles/io_in_while_loops.t ..................... ok
t/spec/S29-any/cmp.t ........................................... ok
===( 4894;238 1/9 0/? 0/? )=======================================Use of uninitialized value
===( 4899;239 6/9 0/? 0/? )=======================================Use of uninitialized value
t/spec/S16-io/basic-open.rakudo ................................ ok
t/spec/S29-array/exists.t ...................................... ok
t/spec/S29-array/keys_values.t ................................. ok
t/spec/S29-array/delete.t ...................................... ok
t/spec/S29-array/elems.rakudo .................................. ok
t/spec/S29-array/kv.t .......................................... ok
t/spec/S29-array/pairs.t ....................................... ok
t/spec/S29-array/pop.t ......................................... ok
t/spec/S29-array/shift.t ....................................... ok
t/spec/S29-context/eval.rakudo ................................. ok
t/spec/S29-array/push.rakudo ................................... ok
t/spec/S29-hash/exists.rakudo .................................. ok
t/spec/S29-array/unshift.t ..................................... ok
t/spec/S29-hash/keys_values.rakudo ............................. ok
===( 5166;255 0/? 0/? 1/9 )=======================================Undefined value - first list match of no matches
Use of uninitialized value
t/spec/S29-list/first.rakudo ................................... ok
t/spec/S29-hash/pairs.rakudo ................................... ok
t/spec/S29-conversions/ord_and_chr.rakudo ...................... ok
t/spec/S29-list/grep.rakudo .................................... ok
t/spec/S29-list/map_empty_list.t ............................... ok
t/spec/S29-list/map_flattening.t ............................... ok
===( 5475;261 1/33 0/? 0/? )=====================================Use of uninitialized value
Use of uninitialized value
t/spec/S29-list/join.t ......................................... ok
t/spec/S29-list/map_function_return_values.rakudo .............. ok
t/spec/S29-list/map.rakudo ..................................... ok
t/spec/S29-list/mutating_listops.t ............................. ok
t/spec/S29-list/map_topic.t .................................... ok
===( 5576;266 0/? 0/? 1/11 )=====================================Use of uninitialized value
Use of uninitialized value
t/spec/S29-list/reduce.rakudo .................................. ok
t/spec/S29-list/minmax.t ....................................... ok
t/spec/S29-list/pick.rakudo .................................... ok
t/spec/S29-num/abs.t ........................................... ok
t/spec/S29-num/complex.rakudo .................................. ok
t/spec/S29-num/exp.rakudo ...................................... ok
t/spec/S29-list/reverse.rakudo ................................. ok
t/spec/S29-num/log.rakudo ...................................... ok
t/spec/S29-list/sort.rakudo .................................... ok
t/spec/S29-num/pi.rakudo ....................................... ok
t/spec/S29-num/rand.t .......................................... ok
===( 5933;278 1/61 0/? 0/? )=====================================Use of uninitialized value
Use of uninitialized value
Use of uninitialized value
Use of uninitialized value
Use of uninitialized value
Use of uninitialized value
Use of uninitialized value
Use of uninitialized value
Use of uninitialized value
Use of uninitialized value
Use of uninitialized value
Use of uninitialized value
Use of uninitialized value
Use of uninitialized value
t/spec/S29-num/int.rakudo ...................................... ok
===( 5994;278 0/? 1/6 0/? )=======================================Use of uninitialized value
t/spec/S29-num/sign.rakudo ..................................... ok
===( 6000;279 0/? 1/7 0/? )=======================================Use of uninitialized value
t/spec/S29-num/sqrt.rakudo ..................................... ok
t/spec/S29-scalar/defined.rakudo ............................... ok
t/spec/S29-str/append.t ........................................ ok
t/spec/S29-str/capitalize.rakudo ............................... ok
t/spec/S29-num/rounders.t ...................................... ok
t/spec/S29-str/chop.rakudo ..................................... ok
===( 6092;286 1/74 0/? 0/? )=====================================Use of uninitialized value
Use of uninitialized value
Use of uninitialized value
Use of uninitialized value
Use of uninitialized value
Use of uninitialized value
Use of uninitialized value
Use of uninitialized value
Use of uninitialized value
Use of uninitialized value
Use of uninitialized value
Use of uninitialized value
Use of uninitialized value
Use of uninitialized value
t/spec/S29-scalar/undef.rakudo ................................. ok
t/spec/S29-str/comb.rakudo ..................................... ok
===( 6184;288 1/31 0/? 0/? )=====================================Use of uninitialized value
Use of uninitialized value
Use of uninitialized value
Use of uninitialized value
t/spec/S29-str/chomp.rakudo .................................... ok
t/spec/S29-str/lcfirst.rakudo .................................. ok
t/spec/S29-str/lc.rakudo ....................................... ok
t/spec/S29-str/pos.t ........................................... ok
===( 6236;290 0/? 0/? )============================================Use of uninitialized value
===( 6237;291 1/35 0/? 0/? )=====================================Use of uninitialized value
t/spec/S29-str/index.rakudo .................................... ok
t/spec/S29-str/split-simple.t .................................. ok
t/spec/S29-str/rindex.rakudo ................................... ok
t/spec/S29-str/uc.rakudo ....................................... ok
t/spec/S29-str/sprintf.rakudo .................................. ok
t/spec/S29-str/ucfirst.rakudo .................................. ok
t/spec/integration/lexical-array-in-inner-block.t .............. ok
t/spec/integration/real-strings.t .............................. ok
t/spec/S29-str/substr.rakudo ................................... ok
t/spec/S29-trig/trig.t ......................................... ok

Test Summary Report

Files=220, Tests=6487, 304 wallclock secs ( 1.65 usr 0.82 sys + 539.47 cusr 22.60 csys = 564.54 CPU)
Result​: FAIL

From @markjreed

On Thu, Nov 13, 2008 at 5​:31 PM, Ovid
<publiustemp-perl6compiler2@​yahoo.com>wrote​:

Now this test passes (r32629), but the Perl 6 test suite is still failing.
Now, however, I can't tell which test fails.

Seems like the summary report should at least include counts of passed vs
failed tests. I assume the result of "FAIL" means that at least one of the
6,487 tests failed, but that's not very informative... but I can't even find
the code that generates this output to try and fix it​:

Test Summary Report

Files=220, Tests=6487, 304 wallclock secs ( 1.65 usr 0.82 sys +
539.47 cusr 22.60 csys = 564.54 CPU)
Result​: FAIL

It would also help if the actual test output weren't overrun with "Use of
uninitialized value". Is that the result of bad tests or bad harness?

--
Mark J. Reed <markjreed@​gmail.com>

From @markjreed

I retract the previous comment. It was based on the file sent by Ovid; when
I run make spectest myself, I get more informative output. In my case, 2 of
the declaration-order tests are what's failing​:

Failed Test Stat Wstat Total Fail List of Failed

t/spec/S12-class/declaration-order.t 0 6 2 0 ??
1490 subtests skipped.

Failed 1/219 test scripts. 0/6484 subtests failed.
Files=219, Tests=6484, 1224 wallclock secs (661.02 cusr + 28.94 csys =
689.96 CPU)

On Thu, Nov 13, 2008 at 6​:03 PM, Mark J. Reed <markjreed@​gmail.com> wrote​:

On Thu, Nov 13, 2008 at 5​:31 PM, Ovid <
publiustemp-perl6compiler2@​yahoo.com> wrote​:

Now this test passes (r32629), but the Perl 6 test suite is still failing.
Now, however, I can't tell which test fails.

Seems like the summary report should at least include counts of passed vs
failed tests. I assume the result of "FAIL" means that at least one of the
6,487 tests failed, but that's not very informative... but I can't even find
the code that generates this output to try and fix it​:

Test Summary Report
-------------------
Files=220, Tests=6487, 304 wallclock secs ( 1.65 usr 0.82 sys + 539.47 cusr 22.60 csys = 564.54 CPU)
Result​: FAIL

It would also help if the actual test output weren't overrun with "Use of
uninitialized value". Is that the result of bad tests or bad harness?

--
Mark J. Reed <markjreed@​gmail.com>

--
Mark J. Reed <markjreed@​gmail.com>

From @pmichaud

On Thu, Nov 13, 2008 at 06​:03​:09PM -0500, Mark J. Reed wrote​:

It would also help if the actual test output weren't overrun with "Use of
uninitialized value". Is that the result of bad tests or bad harness?

In some cases it's bad tests -- i.e., tests that are using
values of undef when they shouldn't

In other cases it's failing tests -- the test fails in a way
that causes an undef value to be used (generating the warning).
An example of this would be when an incorrect result looks up
a value in an array at a non-existent index position.

We could potentially see about disabling the warnings, but
I'd prefer to fix them in the tests when/where we can.

Pm

From @pmichaud

On Thu, Nov 13, 2008 at 06​:03​:09PM -0500, Mark J. Reed wrote​:

Now this test passes \(r32629\), but the Perl 6 test suite is still failing\.
 Now, however, I can't tell which test fails\.

Seems like the summary report should at least include counts of passed vs
failed tests. I assume the result of "FAIL" means that at least one of the
6,487 tests failed, but that's not very informative... but I can't even find
the code that generates this output to try and fix it​:

IIUC, the harness that rakudo is using is ultimately passing control
to Parrot​::Test​::Harness, which in turn uses Test​::Harness.
I don't know much more about it beyond that -- we'd welcome any
efforts to clean up the testing system.

Since Test​::Harness didn't really output the statistics I was
looking for anyway[*], I wrote a simple tools/test_summary.pl
script to run all of the tests and collect output in a form more
useful to me -- perhaps that would work better for you.

[*] At this stage of development, I'm more interested in how
many tests we pass than how many we fail.

Pm

From publiustemp-perl6compiler2@yahoo.com

--- On Thu, 13/11/08, Mark J. Reed <markjreed@​gmail.com> wrote​:

Failed Test Stat Wstat Total Fail
List of Failed
------------------------------------------------------------------------------------------------------------------------------------------------------------
t/spec/S12-class/declaration-order.t 0 6 2 0
??
1490 subtests skipped.

Failed 1/219 test scripts. 0/6484 subtests failed.
Files=219, Tests=6484, 1224 wallclock secs (661.02 cusr +
28.94 csys =
689.96 CPU)

Aha! Mark, what version of Test​::Harness are you running? This looks like 2.X version output and I'm running 3.15. There might be a bug in the newer version which is losing that information.

My best friend from the US arrives in a few hours, though, so there's not likely to be much follow up from me. Sorry.

Cheers,
Ovid
--
Buy the book - http://www.oreilly.com/catalog/perlhks/
Tech blog - http://use.perl.org/~Ovid/journal/
Twitter - http://twitter.com/OvidPerl
Official Perl 6 Wiki - http://www.perlfoundation.org/perl6

From @pmichaud

Is t/spec/S29-conversions/ord_and_char.t still failing for anyone? If
not, I'd like to close this ticket.

Pm

From @moritz

Patrick R. Michaud via RT wrote​:

Is t/spec/S29-conversions/ord_and_char.t still failing for anyone? If
not, I'd like to close this ticket.

It's fine here.

Cheers,
Moritz

From jswitzer@gmail.com

On Mon Dec 15 17​:03​:51 2008, moritz wrote​:

Patrick R. Michaud via RT wrote​:

Is t/spec/S29-conversions/ord_and_char.t still failing for anyone? If
not, I'd like to close this ticket.

It's fine here.

Cheers,
Moritz

As of index 78b38ad..61c292d and r25170, I'm not able to reproduce this
problem. Despite the current usage of undef in the test, it no longer fails.

-Jason "s1n" Switzer

@moritz - Status changed from 'open' to 'resolved'