Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[PATCH] Deep recursion warning with %Module::CoreList::version #15292

Open
p5pRT opened this issue Apr 24, 2016 · 14 comments
Open

[PATCH] Deep recursion warning with %Module::CoreList::version #15292

p5pRT opened this issue Apr 24, 2016 · 14 comments

Comments

@p5pRT
Copy link

p5pRT commented Apr 24, 2016

Migrated from rt.perl.org#127981 (status was 'open')

Searchable as RT127981$

@p5pRT
Copy link
Author

p5pRT commented Apr 24, 2016

From @ntyni

Iterating over %Module​::CoreList​::version elements for Perl >= 5.23.2
causes a deep recursion warning. Apparently the elements are chained
together, and the length of the chain now exceeds the heuristic warning
limit (100).

  % perl -MModule​::CoreList -wE 'say scalar keys %{$Module​::CoreList​::version{5.023002}}'
  Deep recursion on subroutine "Module​::CoreList​::TieHashDelta​::FIRSTKEY" at /usr/share/perl/5.22/Module/CoreList/TieHashDelta.pm line 54.
  622

Proposed patch attached, assuming "no warnings 'recursion'" is fine
on older perls?

Perl Info

Flags:
    category=library
    severity=low
    Type=Patch
    PatchStatus=HasPatch
    module=Module::CoreList

Site configuration information for perl 5.22.1:

Configured by Debian Project at Sun Mar 13 11:54:18 UTC 2016.

Summary of my perl5 (revision 5 version 22 subversion 1) configuration:
   
  Platform:
    osname=linux, osvers=3.16.0, archname=x86_64-linux-gnu-thread-multi
    uname='linux localhost 3.16.0 #1 smp debian 3.16.0 x86_64 gnulinux '
    config_args='-Dusethreads -Duselargefiles -Dcc=x86_64-linux-gnu-gcc -Dcpp=x86_64-linux-gnu-cpp -Dld=x86_64-linux-gnu-gcc -Dccflags=-DDEBIAN -Wdate-time -D_FORTIFY_SOURCE=2 -g -O2 -fstack-protector-strong -Wformat -Werror=format-security -Dldflags= -Wl,-z,relro -Dlddlflags=-shared -Wl,-z,relro -Dcccdlflags=-fPIC -Darchname=x86_64-linux-gnu -Dprefix=/usr -Dprivlib=/usr/share/perl/5.22 -Darchlib=/usr/lib/x86_64-linux-gnu/perl/5.22 -Dvendorprefix=/usr -Dvendorlib=/usr/share/perl5 -Dvendorarch=/usr/lib/x86_64-linux-gnu/perl5/5.22 -Dsiteprefix=/usr/local -Dsitelib=/usr/local/share/perl/5.22.1 -Dsitearch=/usr/local/lib/x86_64-linux-gnu/perl/5.22.1 -Dman1dir=/usr/share/man/man1 -Dman3dir=/usr/share/man/man3 -Dsiteman1dir=/usr/local/man/man1 -Dsiteman3dir=/usr/local/man/man3 -Duse64bitint -Dman1ext=1 -Dman3ext=3perl -Dpager=/usr/bin/sensible-pager -Uafs -Ud_csh -Ud_ualarm -Uusesfio -Uusenm -Ui_libutil -Uversiononly -DDEBUGGING=-g -Doptimize=-O2 -dEs -Duseshrplib [...]
    hint=recommended, useposix=true, d_sigaction=define
    useithreads=define, usemultiplicity=define
    use64bitint=define, use64bitall=define, uselongdouble=undef
    usemymalloc=n, bincompat5005=undef
  Compiler:
    cc='x86_64-linux-gnu-gcc', ccflags ='-D_REENTRANT -D_GNU_SOURCE -DDEBIAN -fwrapv -fno-strict-aliasing -pipe -I/usr/local/include -D_LARGEFILE_SOURCE -D_FILE_OFFSET_BITS=64',
    optimize='-O2 -g',
    cppflags='-D_REENTRANT -D_GNU_SOURCE -DDEBIAN -fwrapv -fno-strict-aliasing -pipe -I/usr/local/include'
    ccversion='', gccversion='5.3.1 20160307', gccosandvers=''
    intsize=4, longsize=8, ptrsize=8, doublesize=8, byteorder=12345678, doublekind=3
    d_longlong=define, longlongsize=8, d_longdbl=define, longdblsize=16, longdblkind=3
    ivtype='long', ivsize=8, nvtype='double', nvsize=8, Off_t='off_t', lseeksize=8
    alignbytes=8, prototype=define
  Linker and Libraries:
    ld='x86_64-linux-gnu-gcc', ldflags =' -fstack-protector-strong -L/usr/local/lib'
    libpth=/usr/local/lib /usr/lib/gcc/x86_64-linux-gnu/5/include-fixed /usr/include/x86_64-linux-gnu /usr/lib /lib/x86_64-linux-gnu /lib/../lib /usr/lib/x86_64-linux-gnu /usr/lib/../lib /lib
    libs=-lgdbm -lgdbm_compat -ldb -ldl -lm -lpthread -lc -lcrypt
    perllibs=-ldl -lm -lpthread -lc -lcrypt
    libc=libc-2.22.so, so=so, useshrplib=true, libperl=libperl.so.5.22
    gnulibc_version='2.22'
  Dynamic Linking:
    dlsrc=dl_dlopen.xs, dlext=so, d_dlsymun=undef, ccdlflags='-Wl,-E'
    cccdlflags='-fPIC', lddlflags='-shared -L/usr/local/lib -fstack-protector-strong'

Locally applied patches:
    DEBPKG:debian/cpan_definstalldirs - Provide a sensible INSTALLDIRS default for modules installed from CPAN.
    DEBPKG:debian/db_file_ver - http://bugs.debian.org/340047 Remove overly restrictive DB_File version check.
    DEBPKG:debian/doc_info - Replace generic man(1) instructions with Debian-specific information.
    DEBPKG:debian/enc2xs_inc - http://bugs.debian.org/290336 Tweak enc2xs to follow symlinks and ignore missing @INC directories.
    DEBPKG:debian/errno_ver - http://bugs.debian.org/343351 Remove Errno version check due to upgrade problems with long-running processes.
    DEBPKG:debian/libperl_embed_doc - http://bugs.debian.org/186778 Note that libperl-dev package is required for embedded linking
    DEBPKG:fixes/respect_umask - Respect umask during installation
    DEBPKG:debian/writable_site_dirs - Set umask approproately for site install directories
    DEBPKG:debian/extutils_set_libperl_path - EU:MM: set location of libperl.a under /usr/lib
    DEBPKG:debian/no_packlist_perllocal - Don't install .packlist or perllocal.pod for perl or vendor
    DEBPKG:debian/fakeroot - Postpone LD_LIBRARY_PATH evaluation to the binary targets.
    DEBPKG:debian/instmodsh_doc - Debian policy doesn't install .packlist files for core or vendor.
    DEBPKG:debian/ld_run_path - Remove standard libs from LD_RUN_PATH as per Debian policy.
    DEBPKG:debian/libnet_config_path - Set location of libnet.cfg to /etc/perl/Net as /usr may not be writable.
    DEBPKG:debian/mod_paths - Tweak @INC ordering for Debian
    DEBPKG:debian/prune_libs - http://bugs.debian.org/128355 Prune the list of libraries wanted to what we actually need.
    DEBPKG:fixes/net_smtp_docs - [rt.cpan.org #36038] http://bugs.debian.org/100195 Document the Net::SMTP 'Port' option
    DEBPKG:debian/perlivp - http://bugs.debian.org/510895 Make perlivp skip include directories in /usr/local
    DEBPKG:debian/deprecate-with-apt - http://bugs.debian.org/747628 Point users to Debian packages of deprecated core modules
    DEBPKG:debian/squelch-locale-warnings - http://bugs.debian.org/508764 Squelch locale warnings in Debian package maintainer scripts
    DEBPKG:debian/skip-upstream-git-tests - Skip tests specific to the upstream Git repository
    DEBPKG:debian/patchlevel - http://bugs.debian.org/567489 List packaged patches for 5.22.1-9 in patchlevel.h
    DEBPKG:debian/skip-kfreebsd-crash - http://bugs.debian.org/628493 [perl #96272] Skip a crashing test case in t/op/threads.t on GNU/kFreeBSD
    DEBPKG:fixes/document_makemaker_ccflags - http://bugs.debian.org/628522 [rt.cpan.org #68613] Document that CCFLAGS should include $Config{ccflags}
    DEBPKG:debian/find_html2text - http://bugs.debian.org/640479 Configure CPAN::Distribution with correct name of html2text
    DEBPKG:debian/perl5db-x-terminal-emulator.patch - http://bugs.debian.org/668490 Invoke x-terminal-emulator rather than xterm in perl5db.pl
    DEBPKG:debian/cpan-missing-site-dirs - http://bugs.debian.org/688842 Fix CPAN::FirstTime defaults with nonexisting site dirs if a parent is writable
    DEBPKG:fixes/memoize_storable_nstore - [rt.cpan.org #77790] http://bugs.debian.org/587650 Memoize::Storable: respect 'nstore' option not respected
    DEBPKG:debian/regen-skip - Skip a regeneration check in unrelated git repositories
    DEBPKG:debian/makemaker-pasthru - http://bugs.debian.org/758471 Pass LD settings through to subdirectories
    DEBPKG:fixes/pod_man_reproducible_date - http://bugs.debian.org/759405 Support POD_MAN_DATE in Pod::Man for the left-hand footer
    DEBPKG:debian/locale-robustness - http://bugs.debian.org/782068 [perl #124310] Make t/run/locale.t survive missing locales masked by LC_ALL
    DEBPKG:fixes/podman-utc - http://bugs.debian.org/780259 Make the embedded date from Pod::Man reproducible
    DEBPKG:fixes/podman-utc-docs - http://bugs.debian.org/780259 Documentation and test suite updates for UTC fix
    DEBPKG:fixes/podman-empty-date - http://bugs.debian.org/780259 Support an empty POD_MAN_DATE environment variable
    DEBPKG:fixes/podman-pipe - http://bugs.debian.org/777405 Better errors for man pages from standard input
    DEBPKG:debian/pod2man-customized - Update porting/customized.dat for pod2man modifications
    DEBPKG:debian/makemaker-manext - http://bugs.debian.org/247370 Make EU::MakeMaker honour MANnEXT settings in generated manpage headers
    DEBPKG:debian/makemaker_customized - Update t/porting/customized.dat for files patched in Debian
    DEBPKG:debian/do-not-record-build-date - [6baa8db] http://bugs.debian.org/774422 [perl #125830] Allow overriding the compile time in "perl -V" output
    DEBPKG:fixes/podman-source-date-epoch - http://bugs.debian.org/801621 Make Pod::Man honor the SOURCE_DATE_EPOCH environment variable
    DEBPKG:fixes/podman-source-date-epoch-cleanups - http://bugs.debian.org/801621 Coding style and documentation for SOURCE_EPOCH_DATE
    DEBPKG:fixes/podman-source-date-epoch-testfix - http://bugs.debian.org/807086 Guard for building with SOURCE_DATE_EPOCH or POD_MAN_DATE set
    DEBPKG:debian/devel-ppport-reproducibility - http://bugs.debian.org/801523 Sort the list of XS code files when generating RealPPPort.xs
    DEBPKG:fixes/encode-unicode-bom - http://bugs.debian.org/798727 [rt.cpan.org #107043] Address https://rt.cpan.org/Public/Bug/Display.html?id=107043
    DEBPKG:debian/encode-unicode-bom-doc - http://bugs.debian.org/798727 Document Debian backport of Encode::Unicode fix
    DEBPKG:debian/kfreebsd-softupdates - http://bugs.debian.org/796798 Work around Debian Bug#796798
    DEBPKG:fixes/autodie-scope - http://bugs.debian.org/798096 Fix a scoping issue with "no autodie" and the "system" sub
    DEBPKG:debian/debugperl-compat-fix - [perl #127212] http://bugs.debian.org/810326 Disable PERL_TRACK_MEMPOOL for debugging builds
    DEBPKG:fixes/CVE-2015-8607_file_spec_taint_fix - http://bugs.debian.org/810719 [perl #126862] ensure File::Spec::canonpath() preserves taint
    DEBPKG:fixes/mkstemp-umask - http://bugs.debian.org/810924 [perl #127322] [e57270b] Fix umask for mkstemp(3) calls
    DEBPKG:fixes/crosscompile-no-targethost - [perl #127234] Fix the Configure escape with usecrosscompile but no targethost
    DEBPKG:fixes/podlators-no-encode - [rt.cpan.org #111156] Degrade gracefully if utf8 is requested but Encode is not available
    DEBPKG:debian/cross-time-hires - [rt.cpan.org #111391] Add an environment variable to skip running configuration probes
    DEBPKG:fixes/encode-unicode-pod - Unicode.pm: Fix POD error
    DEBPKG:fixes/memoize-pod - [rt.cpan.org #89441] Fix POD errors in Memoize
    DEBPKG:fixes/ok-pod - Added encoding for pod.
    DEBPKG:fixes/CVE-2016-2381_duplicate_env - remove duplicate environment variables from environ


@INC for perl 5.22.1:
    /etc/perl
    /usr/local/lib/x86_64-linux-gnu/perl/5.22.1
    /usr/local/share/perl/5.22.1
    /usr/lib/x86_64-linux-gnu/perl5/5.22
    /usr/share/perl5
    /usr/lib/x86_64-linux-gnu/perl/5.22
    /usr/share/perl/5.22
    /usr/local/lib/site_perl
    /usr/lib/x86_64-linux-gnu/perl-base
    .


Environment for perl 5.22.1:
    HOME=/home/niko
    LANG=en_US.UTF-8
    LANGUAGE (unset)
    LC_CTYPE=fi_FI.UTF-8
    LD_LIBRARY_PATH (unset)
    LOGDIR (unset)
    PATH=/home/niko/bin:/home/niko/bin:/home/niko/bin:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/sbin:/usr/sbin:/sbin:/usr/sbin
    PERL_BADLANG (unset)
    SHELL=/bin/zsh

@p5pRT
Copy link
Author

p5pRT commented Apr 24, 2016

From @ntyni

0001-Squelch-deep-recursion-warnings-with-Module-CoreList.patch
From 2575bfb69473b9831d4a3fbb2fdf5279ece0ab70 Mon Sep 17 00:00:00 2001
From: Niko Tyni <ntyni@debian.org>
Date: Sun, 24 Apr 2016 17:27:58 +0300
Subject: [PATCH] Squelch deep recursion warnings with
 %Module::CoreList::version

The version hashes form a chain that gets longer with each Perl
version. Since 5.23.2, the length of the chain has exceeded 100 entries,
causing deep recursion warnings when inflating later hashes.

  % perl -MModule::CoreList -wE 'say scalar keys %{$Module::CoreList::version{5.023002}}'
  Deep recursion on subroutine "Module::CoreList::TieHashDelta::FIRSTKEY" at /usr/share/perl/5.22/Module/CoreList/TieHashDelta.pm line 54.
  622

The recursion is deep but not infinite, so silence the warning.
---
 dist/Module-CoreList/lib/Module/CoreList/TieHashDelta.pm | 3 +++
 dist/Module-CoreList/t/corelist.t                        | 8 +++++++-
 2 files changed, 10 insertions(+), 1 deletion(-)

diff --git a/dist/Module-CoreList/lib/Module/CoreList/TieHashDelta.pm b/dist/Module-CoreList/lib/Module/CoreList/TieHashDelta.pm
index 94507d7..c58bc4c 100644
--- a/dist/Module-CoreList/lib/Module/CoreList/TieHashDelta.pm
+++ b/dist/Module-CoreList/lib/Module/CoreList/TieHashDelta.pm
@@ -48,6 +48,9 @@ sub FIRSTKEY {
     my ($self) = @_;
 
     if (not $self->{keys_inflated}) {
+        # exceeds the warning limit of 100 calls since 5.23.2
+        no warnings 'recursion';
+
         # This inflates the whole set of hashes... Somewhat expensive, but saves
         # many tied hash calls later.
         my @parent_keys;
diff --git a/dist/Module-CoreList/t/corelist.t b/dist/Module-CoreList/t/corelist.t
index db09f48..4adbbe9 100644
--- a/dist/Module-CoreList/t/corelist.t
+++ b/dist/Module-CoreList/t/corelist.t
@@ -1,7 +1,7 @@
 #!perl -w
 use strict;
 use Module::CoreList;
-use Test::More tests => 32;
+use Test::More tests => 34;
 
 BEGIN { require_ok('Module::CoreList'); }
 
@@ -105,6 +105,12 @@ is(Module::CoreList::removed_from('CPANPLUS::inc'), 5.010001,
 
     cmp_ok($warnings_count, '==', 0,
            "an undefined version does not produce warnings rt#123556");
+
+    ok(keys %{$Module::CoreList::version{5.023002}} > 0,
+       "have recent enough data to test for deep recursion warnings");
+
+    cmp_ok($warnings_count, '==', 0,
+           "no deep recursion warnings for newer perl versions");
 }
 
 ok(! defined(Module::CoreList->find_version()),
-- 
2.8.0.rc3

@p5pRT
Copy link
Author

p5pRT commented Apr 24, 2016

From @cpansprout

On Sun Apr 24 12​:35​:03 2016, ntyni@​debian.org wrote​:

This is a bug report for perl from Niko Tyni <ntyni@​debian.org>,
generated with the help of perlbug 1.40 running under perl 5.22.1.

-----------------------------------------------------------------
[Please describe your issue here]

Iterating over %Module​::CoreList​::version elements for Perl >= 5.23.2
causes a deep recursion warning. Apparently the elements are chained
together, and the length of the chain now exceeds the heuristic
warning
limit (100).

% perl -MModule​::CoreList -wE 'say scalar keys
%{$Module​::CoreList​::version{5.023002}}'
Deep recursion on subroutine
"Module​::CoreList​::TieHashDelta​::FIRSTKEY" at
/usr/share/perl/5.22/Module/CoreList/TieHashDelta.pm line 54.
622

Proposed patch attached, assuming "no warnings 'recursion'" is fine
on older perls?

I have used it in 5.8, so it should be fine.

I think this should be fixed before we release 5.24. Your patch looks OK to me, but I have not tested it.

--

Father Chrysostomos

@p5pRT
Copy link
Author

p5pRT commented Apr 24, 2016

The RT System itself - Status changed from 'new' to 'open'

@p5pRT
Copy link
Author

p5pRT commented Apr 25, 2016

From @iabyn

On Sun, Apr 24, 2016 at 02​:48​:46PM -0700, Father Chrysostomos via RT wrote​:

On Sun Apr 24 12​:35​:03 2016, ntyni@​debian.org wrote​:

This is a bug report for perl from Niko Tyni <ntyni@​debian.org>,
generated with the help of perlbug 1.40 running under perl 5.22.1.

-----------------------------------------------------------------
[Please describe your issue here]

Iterating over %Module​::CoreList​::version elements for Perl >= 5.23.2
causes a deep recursion warning. Apparently the elements are chained
together, and the length of the chain now exceeds the heuristic
warning
limit (100).

% perl -MModule​::CoreList -wE 'say scalar keys
%{$Module​::CoreList​::version{5.023002}}'
Deep recursion on subroutine
"Module​::CoreList​::TieHashDelta​::FIRSTKEY" at
/usr/share/perl/5.22/Module/CoreList/TieHashDelta.pm line 54.
622

Proposed patch attached, assuming "no warnings 'recursion'" is fine
on older perls?

I have used it in 5.8, so it should be fine.

I think this should be fixed before we release 5.24.

+1

Its due to a tied lookup recursively looking up parent perl versions
(i.e. working its way back through the chain of deltas between perl
versions), then caching the result.

In the tests the warning only appears occasionally during smoking due to
hash key randomisation affecting the order perl versions are scanned.

Post-5.24 we really ought to fix it properly (iterate rather than
recursive tie lookups) otherwise at some point we're going to blow the C
stack.

--
A power surge on the Bridge is rapidly and correctly diagnosed as a faulty
capacitor by the highly-trained and competent engineering staff.
  -- Things That Never Happen in "Star Trek" #9

@p5pRT
Copy link
Author

p5pRT commented Apr 26, 2016

From @rjbs

* Niko Tyni <perlbug-followup@​perl.org> [2016-04-24T15​:35​:04]

Proposed patch attached, assuming "no warnings 'recursion'" is fine
on older perls?

Thanks, applied as bb8df43.

--
rjbs

@p5pRT
Copy link
Author

p5pRT commented Apr 26, 2016

From @rjbs

* Ricardo Signes <perl.p5p@​rjbs.manxome.org> [2016-04-26T17​:39​:53]

* Niko Tyni <perlbug-followup@​perl.org> [2016-04-24T15​:35​:04]

Proposed patch attached, assuming "no warnings 'recursion'" is fine
on older perls?

Thanks, applied as bb8df43.

Nope, had to rebase. 9baa246

--
rjbs

@p5pRT
Copy link
Author

p5pRT commented Apr 27, 2016

From @ap

* Dave Mitchell <davem@​iabyn.com> [2016-04-25 12​:23]​:

Post-5.24 we really ought to fix it properly

I’m working on that.

@p5pRT
Copy link
Author

p5pRT commented Apr 28, 2016

From @bulk88

On Mon Apr 25 00​:29​:23 2016, davem wrote​:

+1

Its due to a tied lookup recursively looking up parent perl versions
(i.e. working its way back through the chain of deltas between perl
versions), then caching the result.

In the tests the warning only appears occasionally during smoking due to
hash key randomisation affecting the order perl versions are scanned.

Post-5.24 we really ought to fix it properly (iterate rather than
recursive tie lookups) otherwise at some point we're going to blow the C
stack.

For the record I already encountered C stack recursion exhaustion bugs before with TieHashDelta https://rt-archive.perl.org/perl5/Ticket/Display.html?id=121974 and fixed in http​://perl5.git.perl.org/perl.git/commit/42484eedeb4abcee1d893010daa67c1a42ec6424 .

More recursion instead of looping/tailcalling bugs dont surprise me.

--
bulk88 ~ bulk88 at hotmail.com

@p5pRT
Copy link
Author

p5pRT commented Jun 20, 2016

From @iabyn

On Wed, Apr 27, 2016 at 01​:05​:43PM +0200, Aristotle Pagaltzis wrote​:

* Dave Mitchell <davem@​iabyn.com> [2016-04-25 12​:23]​:

Post-5.24 we really ought to fix it properly

I’m working on that.

Any progress?

--
"Foul and greedy Dwarf - you have eaten the last candle."
  -- "Hordes of the Things", BBC Radio.

@p5pRT
Copy link
Author

p5pRT commented Jun 22, 2016

From @ap

Work on the CoreList replacement has been slow, but I have now pushed
smoke-me/ap/tiehashomega for getting rid of TieHashDelta usages as an
intermediary step.

@p5pRT
Copy link
Author

p5pRT commented Dec 27, 2016

From @jkeenan

On Wed, 22 Jun 2016 21​:19​:09 GMT, aristotle wrote​:

Work on the CoreList replacement has been slow, but I have now pushed
smoke-me/ap/tiehashomega for getting rid of TieHashDelta usages as an
intermediary step.

This looks promising. Have you been able to make further progress?

Thank you very much.

--
James E Keenan (jkeenan@​cpan.org)

@p5pRT
Copy link
Author

p5pRT commented Dec 27, 2016

From @ap

* James E Keenan via RT <perlbug-followup@​perl.org> [2016-12-27 02​:24]​:

On Wed, 22 Jun 2016 21​:19​:09 GMT, aristotle wrote​:

Work on the CoreList replacement has been slow, but I have now pushed
smoke-me/ap/tiehashomega for getting rid of TieHashDelta usages as an
intermediary step.

This looks promising. Have you been able to make further progress?

Yeah, applied as 8bbcf42 some time ago.

Sorry I forgot the ticket.

@p5pRT
Copy link
Author

p5pRT commented Dec 27, 2016

From @jkeenan

On Tue, 27 Dec 2016 04​:54​:47 GMT, aristotle wrote​:

* James E Keenan via RT <perlbug-followup@​perl.org> [2016-12-27 02​:24]​:

On Wed, 22 Jun 2016 21​:19​:09 GMT, aristotle wrote​:

Work on the CoreList replacement has been slow, but I have now pushed
smoke-me/ap/tiehashomega for getting rid of TieHashDelta usages as an
intermediary step.

This looks promising. Have you been able to make further progress?

Yeah, applied as 8bbcf42 some time ago.

Sorry I forgot the ticket.

Niko, have we addressed the problem about which you originally posted in this RT?

If so, then we can close the ticket.

Thank you very much.

--
James E Keenan (jkeenan@​cpan.org)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants