Bleadperl breaks SCANNELL/Lingua-GA-Gramadoir-0.70.tar.gz #13804

p5pRT · 2014-05-07T11:55:26Z

Migrated from rt.perl.org#121815 (status was 'resolved')

Searchable as RT121815$

p5pRT · 2014-05-07T11:55:26Z

From @chorny

Makefile.PL for Lingua-GA-Gramadoir takes a lot of time and may run out of
memory when perl 5.19.11 is used both on Windows and Linux. 5.18.2 works
normally and Makefile.PL takes in a couple of seconds. See
http://matrix.cpantesters.org/?dist=Lingua-GA-Gramadoir+0.70

Makefile.PL does not use any modules except EU::MM. Same result with empty
PREREQ_PM.

--
Alexandr Ciornii, http://chorny.net

p5pRT · 2014-05-07T17:57:00Z

From @eserte

Dana Sri 07. Svibanj 2014, 04:55:26, chorny reče:

Makefile.PL for Lingua-GA-Gramadoir takes a lot of time and may run out of
memory when perl 5.19.11 is used both on Windows and Linux. 5.18.2 works
normally and Makefile.PL takes in a couple of seconds. See
http://matrix.cpantesters.org/?dist=Lingua-GA-Gramadoir+0.70

Makefile.PL does not use any modules except EU::MM. Same result with empty
PREREQ_PM.

I also see this problem on a small-memory FreeBSD system (1GB RAM + 1GB Swap).
My initial thought is that -Dusemallocwrap=yes could be responsible for the increased memory usage (nowadays bleadperl is built automatically with this switch, unless explicitly turned off).

p5pRT · 2014-05-07T17:57:00Z

The RT System itself - Status changed from 'new' to 'open'

p5pRT · 2014-05-07T18:30:19Z

From @eserte

Dana Sri 07. Svibanj 2014, 10:57:00, slaven@rezic.de reče:

Dana Sri 07. Svibanj 2014, 04:55:26, chorny reče:

Makefile.PL for Lingua-GA-Gramadoir takes a lot of time and may run
out of
memory when perl 5.19.11 is used both on Windows and Linux. 5.18.2
works
normally and Makefile.PL takes in a couple of seconds. See
http://matrix.cpantesters.org/?dist=Lingua-GA-Gramadoir+0.70

Makefile.PL does not use any modules except EU::MM. Same result with
empty
PREREQ_PM.

I also see this problem on a small-memory FreeBSD system (1GB RAM +
1GB Swap).
My initial thought is that -Dusemallocwrap=yes could be responsible
for the increased memory usage (nowadays bleadperl is built
automatically with this switch, unless explicitly turned off).

No. -Dusemallocwrap=no does not help. Still out of memory errors, this time on a Linux system.

There are more modules which are failing with out of memory with 5.19.11:
* http://matrix.cpantesters.org/?dist=Boost-Geometry-Utils-0.15
* http://matrix.cpantesters.org/?dist=Math-Clipper-1.22

p5pRT · 2014-05-07T19:22:03Z

From @eserte

Dana Sri 07. Svibanj 2014, 11:30:19, slaven@rezic.de reče:

There are more modules which are failing with out of memory with
5.19.11:

And another one, which already has a RT ticket:
* List-Gen-0.974 https://rt-archive.perl.org/perl5/Ticket/Display.html?id=121784

p5pRT · 2014-05-07T19:32:57Z

From @demerphq

On 7 May 2014 20:30, slaven@rezic.de via RT <perlbug-followup@perl.org>wrote:

Dana Sri 07. Svibanj 2014, 10:57:00, slaven@rezic.de reče:

Dana Sri 07. Svibanj 2014, 04:55:26, chorny reče:

Makefile.PL for Lingua-GA-Gramadoir takes a lot of time and may run
out of
memory when perl 5.19.11 is used both on Windows and Linux. 5.18.2
works
normally and Makefile.PL takes in a couple of seconds. See
http://matrix.cpantesters.org/?dist=Lingua-GA-Gramadoir+0.70

Makefile.PL does not use any modules except EU::MM. Same result with
empty
PREREQ_PM.

I also see this problem on a small-memory FreeBSD system (1GB RAM +
1GB Swap).
My initial thought is that -Dusemallocwrap=yes could be responsible
for the increased memory usage (nowadays bleadperl is built
automatically with this switch, unless explicitly turned off).

No. -Dusemallocwrap=no does not help. Still out of memory errors, this
time on a Linux system.

There are more modules which are failing with out of memory with 5.19.11:
* http://matrix.cpantesters.org/?dist=Boost-Geometry-Utils-0.15
* http://matrix.cpantesters.org/?dist=Math-Clipper-1.22

Probably you arent the one to ask, but when I look at this:

http://www.cpantesters.org/cpan/report/9019b1d0-d24e-11e3-bd99-b2cedfbfc7aa

I see a non-verbose test run. It would be nice if the cpan testers project
ran a verbose test when there is a failure and reported that as well. Then
we could at least read the test file, and try to work out why it might run
out of memory where it does, but as it is unless we can duplicate locally
we are out of luck.

Yves

--
perl -Mre=debug -e "/just|another|perl|hacker/"

p5pRT · 2014-05-08T03:33:48Z

From @tonycoz

On Wed May 07 11:30:19 2014, slaven@rezic.de wrote:

Dana Sri 07. Svibanj 2014, 10:57:00, slaven@rezic.de reče:

Dana Sri 07. Svibanj 2014, 04:55:26, chorny reče:

Makefile.PL for Lingua-GA-Gramadoir takes a lot of time and may run
out of
memory when perl 5.19.11 is used both on Windows and Linux. 5.18.2
works
normally and Makefile.PL takes in a couple of seconds. See
http://matrix.cpantesters.org/?dist=Lingua-GA-Gramadoir+0.70

Makefile.PL does not use any modules except EU::MM. Same result
with
empty
PREREQ_PM.

I also see this problem on a small-memory FreeBSD system (1GB RAM +
1GB Swap).
My initial thought is that -Dusemallocwrap=yes could be responsible
for the increased memory usage (nowadays bleadperl is built
automatically with this switch, unless explicitly turned off).

No. -Dusemallocwrap=no does not help. Still out of memory errors, this
time on a Linux system.

There are more modules which are failing with out of memory with
5.19.11:
* http://matrix.cpantesters.org/?dist=Boost-Geometry-Utils-0.15
* http://matrix.cpantesters.org/?dist=Math-Clipper-1.22

I couldn't reproduce any large memory usage on Linux with either blead or v5.19.11 from the Lingua-GA-Gramadoir Makefile.PL.

==32368== HEAP SUMMARY:
==32368== in use at exit: 12,352,602 bytes in 35,841 blocks
==32368== total heap usage: 131,866 allocs, 96,025 frees, 29,530,680 bytes allocated

Is there any chance you could try running the failing Makefile.PL under valgrind to get a clue about what perl is doing when it runs out of memory?

This will need to be perl built with debug info, eg. -Doptimize=-g or -DDEBUGGING=both to provide the best information.

Thanks,
Tony

p5pRT · 2014-05-08T04:43:20Z

From PeterCMartini@GMail.com

I've got a reproducer, and bisecting pointed to 13b0f67, re-enabling COW

On that commit, the output is:
pmartini@pmubuntu:~/opensource/perl/github$ ./miniperl testcase.pl
Size: 862960

On the previous, its:
pmartini@pmubuntu:~/opensource/perl/github$ ./miniperl testcase.pl
Size: 52104

The script I was using is this set of lines from the Makefile.PL and a couple to print the RSS before quitting (where 'file.bs' is 'share/focail6.bs' from that CPAN distribution).

"""
#!./perl -I.

my %FOCAIL;
my $rawfile = "file.bs";
open(DATABASE, $rawfile) or die "Can't open dictionary: $!";
{
local $/ = "\cJ";
my $grambytes;
chomp(my $currword=<DATABASE>);
chomp($grambytes = <DATABASE>);
$FOCAIL{$currword} = $grambytes;
while (<DATABASE>) {
chomp;
m/^([0-9]?)(.*)/;
$currword = substr($currword,0,$1).$2;
chomp ($grambytes = <DATABASE>);
$FOCAIL{$currword} = $grambytes;
}
close DATABASE;
}

my $rss = `ps -p $$ -ho rss`;
print "Size: $rss";
exit ($rss > 100_000);
"""

p5pRT · 2014-05-08T06:49:11Z

From @eserte

Dana Sri 07. Svibanj 2014, 12:22:03, slaven@rezic.de reče:

Dana Sri 07. Svibanj 2014, 11:30:19, slaven@rezic.de reče:

There are more modules which are failing with out of memory with
5.19.11:

And another one:
String-Lookup-0.12 https://rt-archive.perl.org/perl5/Ticket/Display.html?id=121826

p5pRT · 2014-05-08T19:30:30Z

From @andk

"slaven@rezic.de via RT" <perlbug-followup@perl.org> writes:

There are more modules which are failing with out of memory with 5.19.11:
* http://matrix.cpantesters.org/?dist=Boost-Geometry-Utils-0.15
* http://matrix.cpantesters.org/?dist=Math-Clipper-1.22

These two start failing on my system with v5.19.3-97-gfc16c39:

commit fc16c39
Author: Father Chrysostomos <sprout@cpan.org>
Date: Sat Aug 24 19:09:59 2013 -0700

Use SSize_t when extending the stack

The other three mentioned in this thread (Lingua-GA-Gramadoir,
String-Lookup, List-Gen) are not starting to fail for me with this
commit. List-Gen starts much earlier at v5.19.2-122-g5608dcc and
Lingua-GA-Gramadoir and String-Lookup do not fail for me with any recent
bleadperl.

--
andreas

p5pRT · 2014-05-22T16:52:10Z

From @eserte

Dana Sri 07. Svibanj 2014, 04:55:26, chorny reče:

Makefile.PL for Lingua-GA-Gramadoir takes a lot of time and may run out of
memory when perl 5.19.11 is used both on Windows and Linux. 5.18.2 works
normally and Makefile.PL takes in a couple of seconds. See
http://matrix.cpantesters.org/?dist=Lingua-GA-Gramadoir+0.70

Makefile.PL does not use any modules except EU::MM. Same result with empty
PREREQ_PM.

For me the original issue looks resolved: on two systems (FreeBSD 9.2, Debian wheezy) where this distribution failed with an Out of memory error with 5.19.11, it tests fine with 5.20.0-RC1.

This does not say anything about the other distributions mentioned in this thread.

Regards,
Slaven

p5pRT · 2014-06-09T22:13:17Z

From @rjbs

Math-Clipper and Boost-Geometry-Utils are both still OOMing.

--
rjbs

p5pRT · 2014-06-09T22:13:18Z

From [Unknown Contact. See original ticket]

Math-Clipper and Boost-Geometry-Utils are both still OOMing.

--
rjbs

p5pRT · 2014-06-09T22:14:57Z

From @rjbs

On Mon Jun 09 15:13:17 2014, rjbs wrote:

Math-Clipper and Boost-Geometry-Utils are both still OOMing.

B-G-U is diagnosed here:

https://rt-archive.perl.org/perl5/Ticket/Display.html?id=121826#txn-1293820

--
rjbs

p5pRT · 2014-10-23T06:06:16Z

From @tonycoz

On Mon Jun 09 15:14:57 2014, rjbs wrote:

On Mon Jun 09 15:13:17 2014, rjbs wrote:

Math-Clipper and Boost-Geometry-Utils are both still OOMing.

B-G-U is diagnosed here:

https://rt-archive.perl.org/perl5/Ticket/Display.html?id=121826#txn-1293820

I believe this ticket can be closed:

Boost-Geometry-Utils
has patch since 2014-07-04 https://rt.cpan.org/Ticket/Display.html?id=96145

Lingua-GA-Gramadoir
passing for Slaven per https://rt-archive.perl.org/perl5/Ticket/Display.html?id=121815#txn-1293861

Math-Clipper
appears to be the same as Boost-Geometry-Utils, since 1.23 has a change note:

1.23 Thu May 22 20:30:00 2014

- Fix 5.20 compatibility: av_extend is now using
unsigned lengths.

the failures that exist are no longer out of memory errors but is() failures
and occurred in older test results too

List-Gen
A different issue, see https://rt-archive.perl.org/perl5/Ticket/Display.html?id=121784
which is resolved

String-Lookup
has its own ticket https://rt-archive.perl.org/perl5/Ticket/Display.html?id=121826,
which is resolved

Tony

p5pRT · 2014-10-30T03:14:07Z

From @tonycoz

On Wed Oct 22 23:06:16 2014, tonyc wrote:

On Mon Jun 09 15:14:57 2014, rjbs wrote:

On Mon Jun 09 15:13:17 2014, rjbs wrote:

Math-Clipper and Boost-Geometry-Utils are both still OOMing.

B-G-U is diagnosed here:

https://rt-archive.perl.org/perl5/Ticket/Display.html?id=121826#txn-1293820

I believe this ticket can be closed:

Boost-Geometry-Utils
has patch since 2014-07-04
https://rt.cpan.org/Ticket/Display.html?id=96145

Lingua-GA-Gramadoir
passing for Slaven per
https://rt-archive.perl.org/perl5/Ticket/Display.html?id=121815#txn-1293861

Math-Clipper
appears to be the same as Boost-Geometry-Utils, since 1.23 has a
change note:

1.23 Thu May 22 20:30:00 2014

- Fix 5.20 compatibility: av_extend is now using
unsigned lengths.

the failures that exist are no longer out of memory errors but is()
failures
and occurred in older test results too

List-Gen
A different issue, see
https://rt-archive.perl.org/perl5/Ticket/Display.html?id=121784
which is resolved

String-Lookup
has its own ticket
https://rt-archive.perl.org/perl5/Ticket/Display.html?id=121826,
which is resolved

No objections, so closing it.

Tony

p5pRT · 2014-10-30T03:14:08Z

@tonycoz - Status changed from 'open' to 'resolved'

p5pRT closed this as completed Oct 30, 2014

p5pRT added the Severity Low label Oct 19, 2019

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Bleadperl breaks SCANNELL/Lingua-GA-Gramadoir-0.70.tar.gz #13804

Bleadperl breaks SCANNELL/Lingua-GA-Gramadoir-0.70.tar.gz #13804

p5pRT commented May 7, 2014

p5pRT commented May 7, 2014

p5pRT commented May 7, 2014

p5pRT commented May 7, 2014

p5pRT commented May 7, 2014

p5pRT commented May 7, 2014

p5pRT commented May 7, 2014

p5pRT commented May 8, 2014

p5pRT commented May 8, 2014

p5pRT commented May 8, 2014

p5pRT commented May 8, 2014

p5pRT commented May 22, 2014

p5pRT commented Jun 9, 2014

p5pRT commented Jun 9, 2014

p5pRT commented Jun 9, 2014

p5pRT commented Oct 23, 2014

p5pRT commented Oct 30, 2014

p5pRT commented Oct 30, 2014

Navigation Menu

Bleadperl breaks SCANNELL/Lingua-GA-Gramadoir-0.70.tar.gz #13804

Bleadperl breaks SCANNELL/Lingua-GA-Gramadoir-0.70.tar.gz #13804

Comments

p5pRT commented May 7, 2014

p5pRT commented May 7, 2014

From @chorny

p5pRT commented May 7, 2014

From @eserte

p5pRT commented May 7, 2014

p5pRT commented May 7, 2014

From @eserte

p5pRT commented May 7, 2014

From @eserte

p5pRT commented May 7, 2014

From @demerphq

p5pRT commented May 8, 2014

From @tonycoz

p5pRT commented May 8, 2014

From PeterCMartini@GMail.com

p5pRT commented May 8, 2014

From @eserte

p5pRT commented May 8, 2014

From @andk

p5pRT commented May 22, 2014

From @eserte

p5pRT commented Jun 9, 2014

From @rjbs

p5pRT commented Jun 9, 2014

From [Unknown Contact. See original ticket]

p5pRT commented Jun 9, 2014

From @rjbs

p5pRT commented Oct 23, 2014

From @tonycoz

p5pRT commented Oct 30, 2014

From @tonycoz

p5pRT commented Oct 30, 2014