From yuriy.ershov@gmail.com

Hi!

I have just downloaded Rakudo (trunk version, git clone) and have
unicode spectest failed.

Details​:

$ uname -mprv
10.7.0 Darwin Kernel Version 10.7.0​: Sat Jan 29 15​:17​:16 PST 2011;
root​:xnu-1504.9.37~1/RELEASE_I386 i386 i386
$ ./perl6 --version

This is Rakudo Perl 6, version 2011.04-26-g678ad30 built on parrot
3.3.0 RELEASE_3_3_0-199-g3b374ae

$ perl Configure.pl --gen-parrot
.........................
auto​::icu - Is ICU installed....................................yes.
.........................
$ gmake && gmake test && gmake spectest
......................... all test are passed except ...
t/spec/S19-command-line/dash-e.t ...............................
Failed 2/3 subtests
.........................
$ make t/spec/S19-command-line/dash-e.t
t/spec/S19-command-line/dash-e.t ..
1..3
ok 1 - -e print $something works
not ok 2 - -e print $something works with non-ASCII string literals
# got out​: "ȧ"
# expected out​: "ȧ"
not ok 3 - -e works with non-ASCII program texts
# got status​: 1
# got out​: ""
# expected out​: "23"
# got err​: "===SORRY!===\nConfused at line 1, near \"print <1 2\"\n"
# expected err​: ""
# Looks like you failed 2 tests of 3
Failed 2/3 subtests

Test Summary Report

t/spec/S19-command-line/dash-e.t (Wstat​: 0 Tests​: 3 Failed​: 2)
  Failed tests​: 2-3
Files=1, Tests=3, 6 wallclock secs ( 0.02 usr 0.00 sys + 4.81 cusr
0.65 csys = 5.48 CPU)
Result​: FAIL

Ok, the minimal example that does not work is​:

$ ./perl6 -e 'print "ȧ\n"'
ȧ
$ ./perl6 -e 'print "фыв\n"'
фыв

At the same time, perl5 works well​:

Yuriy-Ershovs-MacBook-Air​:rakudo ershov$ perl -e 'print "фыв\n"'
фыв
Yuriy-Ershovs-MacBook-Air​:rakudo ershov$ perl -e 'print "ȧ\n"'
ȧ

The environment is good​:
$ export
.........
declare -x LANG="en_US.UTF-8"
.........

From @masak

This problem has been confirmed to happen in the new nqp as well. It
works on my Ubuntu install of nqp, but it fails on Mac OS X 64 bit.

$ ./nqp -e 'say "<unicode characters here>"
<mojibake here>

The RT System itself - Status changed from 'new' to 'open'

From Jost.Krieger+perl6@ruhr-uni-bochum.de

Installed from Rakudo Star 2012.02

spec-test t/spec/S19-command-line/dash-e.t fails.

even
./perl6 -e 'say "ä"'
gives the wrong result
ä

locale​:
LANG="de_DE.utf-8"

Any information missing?

Jost
--
| Helft Spam ausrotten! HTML in Mail ist unhöflich. |
| Postmaster, JAPH, manchmal Wahrsager am RZ der RUB |
| Bitte immer an Funktionsadressen schreiben​: Postmaster@​rub.de |

From @usev6

Until very recently this has been an issue with Rakudo on Parrot on different *BSD systems. (Nowadays Rakudo also runs on Moar and JVM and on that backends this was not a problem.)

In the last few weeks support for platform encodings (esp. UTF-8) was added for Darwin, FreeBSD, OpenBSD and NetBSD. (For Darwin with this commit​: parrot/parrot@fa21c66).

Since I have no system with Mac OS X I cannot say for sure, that now all tests in S19-command-line/dash-e.t run on Darwin -- but they certainly do on FreeBSD, OpenBSD an NetBSD. Maybe someone else can confirm this for Mac OS X?

So with the next release of Rakudo (Rakudo Star or a monthly compiler release) this should be fixed.

Please note that the tests fail again if you run them with a non-utf8 locale​:

$ LANG=POSIX perl6 t/spec/S19-command-line/dash-e.t

That related problem is mentioned in ticket 116709​: https://rt-archive.perl.org/perl6/Ticket/Display.html?id=116709

The RT System itself - Status changed from 'new' to 'open'

From @usev6

For the time being I manually marked the two failing tests in S19-command-line/dash-e.t as 'todo'​: Raku/roast@640aee1582

I hope this can be undone soon (when Rakudo uses the latest Parrot (see above)).

From @usev6

With the latest parrot the tests in S19-command-line/dash-e.t pass on Mac OS X. I unfudged the tests with commit Raku/roast@5d89b2877e and I'm closing this ticket now.

@usev6 - Status changed from 'open' to 'resolved'