dbicdump takes very long

Previous Topic Next Topic
 
classic Classic list List threaded Threaded
2 messages Options
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

dbicdump takes very long

thilo.fester@googlemail.com
Hello,

I'm just updating my model classes using dbicdump [https://metacpan.org/pod/dbicdump] as I usually do. The output looks good so far -> there are no errors I could refer to.
But the script is painfully slow. I have been waiting for five hours now and the script did not finish yet. My schema has around 120 tables but as far as I remember, it never took so long before.

The config file looks like that ...

<loader_options>
    components                      InflateColumn::DateTime
    components                      Helper::Row::ToJSON
    debug                           1
    db_schema                       MYSCHEMA
    dump_directory                  ./lib
    <naming>
        ALL                         v8
        force_ascii                 1
    </naming>
    overwrite_modifications         1
    skip_load_external              1
    use_moose                       1
</loader_options>

.. without connect string.

I am connected to an Oracle Database 12c (Release 12.1.0.2.0, 64bit). The connection is stable and Oracle is processing and delivering results pretty fast for usual queries.

My machines load average: 0,30, 0,41, 0,36

Where is the bottleneck? Did anybody observe this or a similar behaviour before?

Regards
Thilo

_______________________________________________
List: http://lists.scsys.co.uk/cgi-bin/mailman/listinfo/dbix-class
IRC: irc.perl.org#dbix-class
SVN: http://dev.catalyst.perl.org/repos/bast/DBIx-Class/
Searchable Archive: http://www.grokbase.com/group/dbix-class@...
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: dbicdump takes very long

Lasse Makholm
DBIx::Class::Schema::Loader does *a lot* of queries on your DB to introspect it, so runtime is heavily dependant on latency to your DB server....

Try tracing the queries:

DBI_TRACE=1 dbicdump ...

That should give you an idea of why it's so slow... In my experience, most of the time is spent making queries, as opposed to actually generating your result classes....

/L 

On Fri, Jul 10, 2015 at 1:19 PM, [hidden email] <[hidden email]> wrote:
Hello,

I'm just updating my model classes using dbicdump [https://metacpan.org/pod/dbicdump] as I usually do. The output looks good so far -> there are no errors I could refer to.
But the script is painfully slow. I have been waiting for five hours now and the script did not finish yet. My schema has around 120 tables but as far as I remember, it never took so long before.

The config file looks like that ...

<loader_options>
    components                      InflateColumn::DateTime
    components                      Helper::Row::ToJSON
    debug                           1
    db_schema                       MYSCHEMA
    dump_directory                  ./lib
    <naming>
        ALL                         v8
        force_ascii                 1
    </naming>
    overwrite_modifications         1
    skip_load_external              1
    use_moose                       1
</loader_options>

.. without connect string.

I am connected to an Oracle Database 12c (Release 12.1.0.2.0, 64bit). The connection is stable and Oracle is processing and delivering results pretty fast for usual queries.

My machines load average: 0,30, 0,41, 0,36

Where is the bottleneck? Did anybody observe this or a similar behaviour before?

Regards
Thilo

_______________________________________________
List: http://lists.scsys.co.uk/cgi-bin/mailman/listinfo/dbix-class
IRC: irc.perl.org#dbix-class
SVN: http://dev.catalyst.perl.org/repos/bast/DBIx-Class/
Searchable Archive: http://www.grokbase.com/group/dbix-class@...


_______________________________________________
List: http://lists.scsys.co.uk/cgi-bin/mailman/listinfo/dbix-class
IRC: irc.perl.org#dbix-class
SVN: http://dev.catalyst.perl.org/repos/bast/DBIx-Class/
Searchable Archive: http://www.grokbase.com/group/dbix-class@...
Loading...