Fix exception on complex update/delete under a replicated setup
[dbsrgits/DBIx-Class.git] / lib / DBIx / Class / Storage / DBI / Replicated.pm
CommitLineData
2156bbdd 1package DBIx::Class::Storage::DBI::Replicated;
f5d3a5de 2
ecb65397 3BEGIN {
a34b0c89 4 use DBIx::Class;
70c28808 5 die('The following modules are required for Replication ' . DBIx::Class::Optional::Dependencies->req_missing_for ('replicated') . "\n" )
a34b0c89 6 unless DBIx::Class::Optional::Dependencies->req_ok_for ('replicated');
ecb65397 7}
8
b2e4d522 9use Moose;
26ab719a 10use DBIx::Class::Storage::DBI;
2bf79155 11use DBIx::Class::Storage::DBI::Replicated::Pool;
26ab719a 12use DBIx::Class::Storage::DBI::Replicated::Balancer;
6a151f58 13use DBIx::Class::Storage::DBI::Replicated::Types qw/BalancerClassNamePart DBICSchema DBICStorageDBI/;
41916570 14use MooseX::Types::Moose qw/ClassName HashRef Object/;
b2e4d522 15use Scalar::Util 'reftype';
e666c5fd 16use Hash::Merge;
7da56142 17use List::Util qw/min max reduce/;
1abccf54 18use Context::Preserve 'preserve_context';
ed7ab0f4 19use Try::Tiny;
9901aad7 20
21use namespace::clean -except => 'meta';
2bf79155 22
23=head1 NAME
24
ecb65397 25DBIx::Class::Storage::DBI::Replicated - BETA Replicated database support
2bf79155 26
27=head1 SYNOPSIS
28
29The Following example shows how to change an existing $schema to a replicated
48580715 30storage type, add some replicated (read-only) databases, and perform reporting
955a6df6 31tasks.
2bf79155 32
3da4f736 33You should set the 'storage_type attribute to a replicated type. You should
d4daee7b 34also define your arguments, such as which balancer you want and any arguments
3da4f736 35that the Pool object should get.
36
ce854fd3 37 my $schema = Schema::Class->clone;
592fa86f 38 $schema->storage_type(['::DBI::Replicated', { balancer_type => '::Random' }]);
ce854fd3 39 $schema->connection(...);
d4daee7b 40
fd323bf1 41Next, you need to add in the Replicants. Basically this is an array of
3da4f736 42arrayrefs, where each arrayref is database connect information. Think of these
43arguments as what you'd pass to the 'normal' $schema->connect method.
d4daee7b 44
64cdad22 45 $schema->storage->connect_replicants(
46 [$dsn1, $user, $pass, \%opts],
47 [$dsn2, $user, $pass, \%opts],
48 [$dsn3, $user, $pass, \%opts],
49 );
d4daee7b 50
3da4f736 51Now, just use the $schema as you normally would. Automatically all reads will
52be delegated to the replicants, while writes to the master.
53
7e38d850 54 $schema->resultset('Source')->search({name=>'etc'});
d4daee7b 55
3da4f736 56You can force a given query to use a particular storage using the search
57attribute 'force_pool'. For example:
d4daee7b 58
d7c37d66 59 my $rs = $schema->resultset('Source')->search(undef, {force_pool=>'master'});
3da4f736 60
d7c37d66 61Now $rs will force everything (both reads and writes) to use whatever was setup
fd323bf1 62as the master storage. 'master' is hardcoded to always point to the Master,
3da4f736 63but you can also use any Replicant name. Please see:
212cc5c2 64L<DBIx::Class::Storage::DBI::Replicated::Pool> and the replicants attribute for more.
3da4f736 65
66Also see transactions and L</execute_reliably> for alternative ways to
67force read traffic to the master. In general, you should wrap your statements
68in a transaction when you are reading and writing to the same tables at the
69same time, since your replicants will often lag a bit behind the master.
212cc5c2 70
d7c37d66 71If you have a multi-statement read only transaction you can force it to select
72a random server in the pool by:
73
74 my $rs = $schema->resultset('Source')->search( undef,
75 { force_pool => $db->storage->read_handler->next_storage }
76 );
d4daee7b 77
2bf79155 78=head1 DESCRIPTION
79
7e38d850 80Warning: This class is marked BETA. This has been running a production
ccb3b897 81website using MySQL native replication as its backend and we have some decent
7e38d850 82test coverage but the code hasn't yet been stressed by a variety of databases.
48580715 83Individual DBs may have quirks we are not aware of. Please use this in first
7e38d850 84development and pass along your experiences/bug fixes.
2bf79155 85
86This class implements replicated data store for DBI. Currently you can define
87one master and numerous slave database connections. All write-type queries
88(INSERT, UPDATE, DELETE and even LAST_INSERT_ID) are routed to master
89database, all read-type queries (SELECTs) go to the slave database.
90
91Basically, any method request that L<DBIx::Class::Storage::DBI> would normally
bca099a3 92handle gets delegated to one of the two attributes: L</read_handler> or to
93L</write_handler>. Additionally, some methods need to be distributed
2bf79155 94to all existing storages. This way our storage class is a drop in replacement
95for L<DBIx::Class::Storage::DBI>.
96
48580715 97Read traffic is spread across the replicants (slaves) occurring to a user
2bf79155 98selected algorithm. The default algorithm is random weighted.
99
bca099a3 100=head1 NOTES
101
48580715 102The consistency between master and replicants is database specific. The Pool
faaba25f 103gives you a method to validate its replicants, removing and replacing them
7e38d850 104when they fail/pass predefined criteria. Please make careful use of the ways
ecb65397 105to force a query to run against Master when needed.
106
107=head1 REQUIREMENTS
108
a34b0c89 109Replicated Storage has additional requirements not currently part of
aa8b2277 110L<DBIx::Class>. See L<DBIx::Class::Optional::Dependencies> for more details.
2bf79155 111
112=head1 ATTRIBUTES
113
114This class defines the following attributes.
115
2ce6e9a6 116=head2 schema
117
118The underlying L<DBIx::Class::Schema> object this storage is attaching
119
120=cut
121
122has 'schema' => (
123 is=>'rw',
6a151f58 124 isa=>DBICSchema,
2ce6e9a6 125 weak_ref=>1,
126 required=>1,
127);
128
26ab719a 129=head2 pool_type
2bf79155 130
fd323bf1 131Contains the classname which will instantiate the L</pool> object. Defaults
26ab719a 132to: L<DBIx::Class::Storage::DBI::Replicated::Pool>.
2bf79155 133
134=cut
135
26ab719a 136has 'pool_type' => (
dcdf7b2c 137 is=>'rw',
41916570 138 isa=>ClassName,
2ce6e9a6 139 default=>'DBIx::Class::Storage::DBI::Replicated::Pool',
64cdad22 140 handles=>{
141 'create_pool' => 'new',
142 },
2bf79155 143);
144
f068a139 145=head2 pool_args
146
147Contains a hashref of initialized information to pass to the Balancer object.
212cc5c2 148See L<DBIx::Class::Storage::DBI::Replicated::Pool> for available arguments.
f068a139 149
150=cut
151
152has 'pool_args' => (
dcdf7b2c 153 is=>'rw',
41916570 154 isa=>HashRef,
64cdad22 155 lazy=>1,
64cdad22 156 default=>sub { {} },
f068a139 157);
158
159
26ab719a 160=head2 balancer_type
2bf79155 161
162The replication pool requires a balance class to provider the methods for
163choose how to spread the query load across each replicant in the pool.
164
165=cut
166
26ab719a 167has 'balancer_type' => (
dcdf7b2c 168 is=>'rw',
9901aad7 169 isa=>BalancerClassNamePart,
2ce6e9a6 170 coerce=>1,
171 required=>1,
172 default=> 'DBIx::Class::Storage::DBI::Replicated::Balancer::First',
64cdad22 173 handles=>{
174 'create_balancer' => 'new',
175 },
2bf79155 176);
177
17b05c13 178=head2 balancer_args
179
180Contains a hashref of initialized information to pass to the Balancer object.
212cc5c2 181See L<DBIx::Class::Storage::DBI::Replicated::Balancer> for available arguments.
17b05c13 182
183=cut
184
185has 'balancer_args' => (
dcdf7b2c 186 is=>'rw',
41916570 187 isa=>HashRef,
64cdad22 188 lazy=>1,
189 required=>1,
190 default=>sub { {} },
17b05c13 191);
192
26ab719a 193=head2 pool
2bf79155 194
370f78d4 195Is a L<DBIx::Class::Storage::DBI::Replicated::Pool> or derived class. This is a
26ab719a 196container class for one or more replicated databases.
2bf79155 197
198=cut
199
26ab719a 200has 'pool' => (
64cdad22 201 is=>'ro',
202 isa=>'DBIx::Class::Storage::DBI::Replicated::Pool',
203 lazy_build=>1,
204 handles=>[qw/
6f7344b8 205 connect_replicants
64cdad22 206 replicants
207 has_replicants
208 /],
2bf79155 209);
210
26ab719a 211=head2 balancer
2bf79155 212
370f78d4 213Is a L<DBIx::Class::Storage::DBI::Replicated::Balancer> or derived class. This
214is a class that takes a pool (L<DBIx::Class::Storage::DBI::Replicated::Pool>)
2bf79155 215
26ab719a 216=cut
2bf79155 217
26ab719a 218has 'balancer' => (
dcdf7b2c 219 is=>'rw',
64cdad22 220 isa=>'DBIx::Class::Storage::DBI::Replicated::Balancer',
221 lazy_build=>1,
222 handles=>[qw/auto_validate_every/],
26ab719a 223);
2bf79155 224
cb6ec758 225=head2 master
226
227The master defines the canonical state for a pool of connected databases. All
228the replicants are expected to match this databases state. Thus, in a classic
229Master / Slaves distributed system, all the slaves are expected to replicate
230the Master's state as quick as possible. This is the only database in the
231pool of databases that is allowed to handle write traffic.
232
233=cut
234
235has 'master' => (
64cdad22 236 is=> 'ro',
6a151f58 237 isa=>DBICStorageDBI,
64cdad22 238 lazy_build=>1,
cb6ec758 239);
240
cb6ec758 241=head1 ATTRIBUTES IMPLEMENTING THE DBIx::Storage::DBI INTERFACE
242
fd323bf1 243The following methods are delegated all the methods required for the
cb6ec758 244L<DBIx::Class::Storage::DBI> interface.
245
cb6ec758 246=cut
247
4bea1fe7 248my $method_dispatch = {
249 writer => [qw/
64cdad22 250 on_connect_do
6f7344b8 251 on_disconnect_do
3244fdcc 252 on_connect_call
253 on_disconnect_call
64cdad22 254 connect_info
3244fdcc 255 _connect_info
64cdad22 256 throw_exception
257 sql_maker
258 sqlt_type
259 create_ddl_dir
260 deployment_statements
261 datetime_parser
6f7344b8 262 datetime_parser_type
263 build_datetime_parser
64cdad22 264 last_insert_id
265 insert
64cdad22 266 update
267 delete
268 dbh
2ce6e9a6 269 txn_begin
64cdad22 270 txn_do
271 txn_commit
272 txn_rollback
2ce6e9a6 273 txn_scope_guard
90d7422f 274 _exec_txn_rollback
275 _exec_txn_begin
276 _exec_txn_commit
64cdad22 277 deploy
0180bef9 278 with_deferred_fk_checks
6f7344b8 279 dbh_do
2ce6e9a6 280 _prep_for_execute
6f7344b8 281 is_datatype_numeric
282 _count_select
6f7344b8 283 svp_rollback
284 svp_begin
285 svp_release
e398f77e 286 relname_to_table_alias
3244fdcc 287 _dbh_last_insert_id
3244fdcc 288 _default_dbi_connect_attributes
289 _dbi_connect_info
b9ca4ff1 290 _dbic_connect_attributes
3244fdcc 291 auto_savepoint
0e773352 292 _query_start
3244fdcc 293 _query_end
0e773352 294 _format_for_trace
295 _dbi_attrs_for_bind
3244fdcc 296 bind_attribute_by_data_type
297 transaction_depth
298 _dbh
299 _select_args
52cef7e3 300 _dbh_execute_for_fetch
3244fdcc 301 _sql_maker
3244fdcc 302 _dbh_execute_inserts_with_no_binds
303 _select_args_to_query
5e782048 304 _gen_sql_bind
3244fdcc 305 _svp_generate_name
3244fdcc 306 _normalize_connect_info
307 _parse_connect_do
3244fdcc 308 savepoints
3244fdcc 309 _sql_maker_opts
7f95ea99 310 _use_multicolumn_in
3244fdcc 311 _conn_pid
3244fdcc 312 _dbh_autocommit
313 _native_data_type
314 _get_dbh
315 sql_maker_class
2a6dda4b 316 insert_bulk
317 _insert_bulk
3244fdcc 318 _execute
319 _do_query
3244fdcc 320 _dbh_execute
5b4f3fd0 321 /, Class::MOP::Class->initialize('DBIx::Class::Storage::DBIHacks')->get_method_list ],
4bea1fe7 322 reader => [qw/
323 select
324 select_single
325 columns_info_for
326 _dbh_columns_info_for
327 _select
328 /],
329 unimplemented => [qw/
330 _arm_global_destructor
331 _verify_pid
332
333 get_use_dbms_capability
334 set_use_dbms_capability
335 get_dbms_capability
336 set_dbms_capability
337 _dbh_details
338 _dbh_get_info
339
75d3bdb2 340 _determine_connector_driver
37b5ab51 341 _extract_driver_from_connect_info
75d3bdb2 342 _describe_connection
343 _warn_undetermined_driver
344
4bea1fe7 345 sql_limit_dialect
346 sql_quote_char
347 sql_name_sep
348
4bea1fe7 349 _prefetch_autovalues
fabbd5cc 350 _perform_autoinc_retrieval
351 _autoinc_supplied_for_op
4bea1fe7 352
eec07bca 353 _resolve_bindattrs
354
4bea1fe7 355 _max_column_bytesize
356 _is_lob_type
357 _is_binary_lob_type
5efba7fc 358 _is_binary_type
4bea1fe7 359 _is_text_lob_type
402ac1c9 360
9930caaf 361 _prepare_sth
362 _bind_sth_params
4bea1fe7 363 /,(
364 # the capability framework
365 # not sure if CMOP->initialize does evil things to DBIC::S::DBI, fix if a problem
366 grep
7f95ea99 367 { $_ =~ /^ _ (?: use | supports | determine_supports ) _ /x and $_ ne '_use_multicolumn_in' }
4bea1fe7 368 ( Class::MOP::Class->initialize('DBIx::Class::Storage::DBI')->get_all_method_names )
369 )],
370};
371
372if (DBIx::Class::_ENV_::DBICTEST) {
373
374 my $seen;
375 for my $type (keys %$method_dispatch) {
376 for (@{$method_dispatch->{$type}}) {
377 push @{$seen->{$_}}, $type;
378 }
379 }
cb6ec758 380
4bea1fe7 381 if (my @dupes = grep { @{$seen->{$_}} > 1 } keys %$seen) {
382 die(join "\n", '',
383 'The following methods show up multiple times in ::Storage::DBI::Replicated handlers:',
384 (map { "$_: " . (join ', ', @{$seen->{$_}}) } sort @dupes),
385 '',
386 );
387 }
bbdda281 388
4bea1fe7 389 if (my @cant = grep { ! DBIx::Class::Storage::DBI->can($_) } keys %$seen) {
390 die(join "\n", '',
391 '::Storage::DBI::Replicated specifies handling of the following *NON EXISTING* ::Storage::DBI methods:',
392 @cant,
393 '',
394 );
395 }
396}
bbdda281 397
4bea1fe7 398for my $method (@{$method_dispatch->{unimplemented}}) {
399 __PACKAGE__->meta->add_method($method, sub {
70c28808 400 my $self = shift;
e705f529 401 $self->throw_exception("$method() must not be called on ".(blessed $self).' objects');
4bea1fe7 402 });
403}
31a8aaaf 404
4bea1fe7 405=head2 read_handler
584ea6e4 406
5529838f 407Defines an object that implements the read side of L<DBIx::Class::Storage::DBI>.
584ea6e4 408
4bea1fe7 409=cut
410
411has 'read_handler' => (
412 is=>'rw',
413 isa=>Object,
414 lazy_build=>1,
415 handles=>$method_dispatch->{reader},
e471ab87 416);
417
4bea1fe7 418=head2 write_handler
419
5529838f 420Defines an object that implements the write side of L<DBIx::Class::Storage::DBI>,
4bea1fe7 421as well as methods that don't write or read that can be called on only one
422storage, methods that return a C<$dbh>, and any methods that don't make sense to
423run on a replicant.
424
425=cut
426
427has 'write_handler' => (
428 is=>'ro',
429 isa=>Object,
430 lazy_build=>1,
431 handles=>$method_dispatch->{writer},
7f4433eb 432);
433
4bea1fe7 434
6d766626 435
b2e4d522 436has _master_connect_info_opts =>
437 (is => 'rw', isa => HashRef, default => sub { {} });
438
439=head2 around: connect_info
440
48580715 441Preserves master's C<connect_info> options (for merging with replicants.)
442Also sets any Replicated-related options from connect_info, such as
dcdf7b2c 443C<pool_type>, C<pool_args>, C<balancer_type> and C<balancer_args>.
b2e4d522 444
445=cut
446
447around connect_info => sub {
448 my ($next, $self, $info, @extra) = @_;
449
1fccee7b 450 $self->throw_exception(
451 'connect_info can not be retrieved from a replicated storage - '
452 . 'accessor must be called on a specific pool instance'
453 ) unless defined $info;
454
282a9a4f 455 my $merge = Hash::Merge->new('LEFT_PRECEDENT');
e666c5fd 456
b2e4d522 457 my %opts;
458 for my $arg (@$info) {
459 next unless (reftype($arg)||'') eq 'HASH';
e666c5fd 460 %opts = %{ $merge->merge($arg, \%opts) };
b2e4d522 461 }
b2e4d522 462 delete $opts{dsn};
463
dcdf7b2c 464 if (@opts{qw/pool_type pool_args/}) {
465 $self->pool_type(delete $opts{pool_type})
466 if $opts{pool_type};
467
b88b85e7 468 $self->pool_args(
e666c5fd 469 $merge->merge((delete $opts{pool_args} || {}), $self->pool_args)
b88b85e7 470 );
dcdf7b2c 471
64ae1667 472 ## Since we possibly changed the pool_args, we need to clear the current
473 ## pool object so that next time it is used it will be rebuilt.
474 $self->clear_pool;
dcdf7b2c 475 }
476
477 if (@opts{qw/balancer_type balancer_args/}) {
478 $self->balancer_type(delete $opts{balancer_type})
479 if $opts{balancer_type};
480
b88b85e7 481 $self->balancer_args(
e666c5fd 482 $merge->merge((delete $opts{balancer_args} || {}), $self->balancer_args)
b88b85e7 483 );
dcdf7b2c 484
67c43863 485 $self->balancer($self->_build_balancer)
6f7344b8 486 if $self->balancer;
dcdf7b2c 487 }
488
b2e4d522 489 $self->_master_connect_info_opts(\%opts);
490
1abccf54 491 return preserve_context {
492 $self->$next($info, @extra);
493 } after => sub {
494 # Make sure master is blessed into the correct class and apply role to it.
495 my $master = $self->master;
496 $master->_determine_driver;
497 Moose::Meta::Class->initialize(ref $master);
cea43436 498
1abccf54 499 DBIx::Class::Storage::DBI::Replicated::WithDSN->meta->apply($master);
0ce2d0d5 500
1abccf54 501 # link pool back to master
502 $self->pool->master($master);
503 };
b2e4d522 504};
505
26ab719a 506=head1 METHODS
2bf79155 507
26ab719a 508This class defines the following methods.
2bf79155 509
c354902c 510=head2 BUILDARGS
2bf79155 511
faaba25f 512L<DBIx::Class::Schema> when instantiating its storage passed itself as the
2ce6e9a6 513first argument. So we need to massage the arguments a bit so that all the
514bits get put into the correct places.
2bf79155 515
516=cut
517
c354902c 518sub BUILDARGS {
fd323bf1 519 my ($class, $schema, $storage_type_args, @args) = @_;
d4daee7b 520
c354902c 521 return {
6f7344b8 522 schema=>$schema,
523 %$storage_type_args,
524 @args
c354902c 525 }
526}
2bf79155 527
cb6ec758 528=head2 _build_master
2bf79155 529
cb6ec758 530Lazy builder for the L</master> attribute.
2bf79155 531
532=cut
533
cb6ec758 534sub _build_master {
2ce6e9a6 535 my $self = shift @_;
ee356d00 536 my $master = DBIx::Class::Storage::DBI->new($self->schema);
ee356d00 537 $master
106d5f3b 538}
539
26ab719a 540=head2 _build_pool
2bf79155 541
26ab719a 542Lazy builder for the L</pool> attribute.
2bf79155 543
544=cut
545
26ab719a 546sub _build_pool {
64cdad22 547 my $self = shift @_;
548 $self->create_pool(%{$self->pool_args});
2bf79155 549}
550
26ab719a 551=head2 _build_balancer
2bf79155 552
cb6ec758 553Lazy builder for the L</balancer> attribute. This takes a Pool object so that
554the balancer knows which pool it's balancing.
2bf79155 555
556=cut
557
26ab719a 558sub _build_balancer {
64cdad22 559 my $self = shift @_;
560 $self->create_balancer(
6f7344b8 561 pool=>$self->pool,
64cdad22 562 master=>$self->master,
563 %{$self->balancer_args},
564 );
2bf79155 565}
566
cb6ec758 567=head2 _build_write_handler
2bf79155 568
cb6ec758 569Lazy builder for the L</write_handler> attribute. The default is to set this to
570the L</master>.
50336325 571
572=cut
573
cb6ec758 574sub _build_write_handler {
64cdad22 575 return shift->master;
cb6ec758 576}
50336325 577
cb6ec758 578=head2 _build_read_handler
2bf79155 579
cb6ec758 580Lazy builder for the L</read_handler> attribute. The default is to set this to
581the L</balancer>.
2bf79155 582
583=cut
584
cb6ec758 585sub _build_read_handler {
64cdad22 586 return shift->balancer;
cb6ec758 587}
50336325 588
cb6ec758 589=head2 around: connect_replicants
2bf79155 590
cb6ec758 591All calls to connect_replicants needs to have an existing $schema tacked onto
5529838f 592top of the args, since L<DBIx::Class::Storage::DBI> needs it, and any
593L<connect_info|DBIx::Class::Storage::DBI/connect_info>
b2e4d522 594options merged with the master, with replicant opts having higher priority.
955a6df6 595
cb6ec758 596=cut
955a6df6 597
b2e4d522 598around connect_replicants => sub {
599 my ($next, $self, @args) = @_;
600
601 for my $r (@args) {
602 $r = [ $r ] unless reftype $r eq 'ARRAY';
603
1a58752c 604 $self->throw_exception('coderef replicant connect_info not supported')
b2e4d522 605 if ref $r->[0] && reftype $r->[0] eq 'CODE';
606
607# any connect_info options?
608 my $i = 0;
609 $i++ while $i < @$r && (reftype($r->[$i])||'') ne 'HASH';
610
6f7344b8 611# make one if none
b2e4d522 612 $r->[$i] = {} unless $r->[$i];
613
614# merge if two hashes
b88b85e7 615 my @hashes = @$r[$i .. $#{$r}];
616
1a58752c 617 $self->throw_exception('invalid connect_info options')
b88b85e7 618 if (grep { reftype($_) eq 'HASH' } @hashes) != @hashes;
619
1a58752c 620 $self->throw_exception('too many hashrefs in connect_info')
b88b85e7 621 if @hashes > 2;
622
282a9a4f 623 my $merge = Hash::Merge->new('LEFT_PRECEDENT');
e666c5fd 624 my %opts = %{ $merge->merge(reverse @hashes) };
b88b85e7 625
626# delete them
b2e4d522 627 splice @$r, $i+1, ($#{$r} - $i), ();
628
0bd8e058 629# make sure master/replicants opts don't clash
630 my %master_opts = %{ $self->_master_connect_info_opts };
631 if (exists $opts{dbh_maker}) {
632 delete @master_opts{qw/dsn user password/};
633 }
634 delete $master_opts{dbh_maker};
635
b2e4d522 636# merge with master
e666c5fd 637 %opts = %{ $merge->merge(\%opts, \%master_opts) };
b2e4d522 638
639# update
640 $r->[$i] = \%opts;
641 }
642
643 $self->$next($self->schema, @args);
955a6df6 644};
2bf79155 645
2bf79155 646=head2 all_storages
647
4a0eed52 648Returns an array of all the connected storage backends. The first element
649in the returned array is the master, and the rest are each of the
2bf79155 650replicants.
651
652=cut
653
654sub all_storages {
64cdad22 655 my $self = shift @_;
656 return grep {defined $_ && blessed $_} (
657 $self->master,
6412a592 658 values %{ $self->replicants },
64cdad22 659 );
2bf79155 660}
661
c4d3fae2 662=head2 execute_reliably ($coderef, ?@args)
663
664Given a coderef, saves the current state of the L</read_handler>, forces it to
48580715 665use reliable storage (e.g. sets it to the master), executes a coderef and then
c4d3fae2 666restores the original state.
667
668Example:
669
64cdad22 670 my $reliably = sub {
671 my $name = shift @_;
672 $schema->resultset('User')->create({name=>$name});
fd323bf1 673 my $user_rs = $schema->resultset('User')->find({name=>$name});
64cdad22 674 return $user_rs;
675 };
c4d3fae2 676
64cdad22 677 my $user_rs = $schema->storage->execute_reliably($reliably, 'John');
c4d3fae2 678
679Use this when you must be certain of your database state, such as when you just
680inserted something and need to get a resultset including it, etc.
681
682=cut
683
684sub execute_reliably {
1abccf54 685 my $self = shift;
686 my $coderef = shift;
d4daee7b 687
64cdad22 688 unless( ref $coderef eq 'CODE') {
689 $self->throw_exception('Second argument must be a coderef');
690 }
d4daee7b 691
1abccf54 692 ## replace the current read handler for the remainder of the scope
693 local $self->{read_handler} = $self->master;
d4daee7b 694
1abccf54 695 my $args = \@_;
696 return try {
697 $coderef->(@$args);
ed7ab0f4 698 } catch {
699 $self->throw_exception("coderef returned an error: $_");
64cdad22 700 };
c4d3fae2 701}
702
cb6ec758 703=head2 set_reliable_storage
704
705Sets the current $schema to be 'reliable', that is all queries, both read and
706write are sent to the master
d4daee7b 707
cb6ec758 708=cut
709
710sub set_reliable_storage {
64cdad22 711 my $self = shift @_;
712 my $schema = $self->schema;
713 my $write_handler = $self->schema->storage->write_handler;
d4daee7b 714
64cdad22 715 $schema->storage->read_handler($write_handler);
cb6ec758 716}
717
718=head2 set_balanced_storage
719
720Sets the current $schema to be use the </balancer> for all reads, while all
48580715 721writes are sent to the master only
d4daee7b 722
cb6ec758 723=cut
724
725sub set_balanced_storage {
64cdad22 726 my $self = shift @_;
727 my $schema = $self->schema;
bd5da369 728 my $balanced_handler = $self->schema->storage->balancer;
d4daee7b 729
bd5da369 730 $schema->storage->read_handler($balanced_handler);
cb6ec758 731}
2bf79155 732
733=head2 connected
734
735Check that the master and at least one of the replicants is connected.
736
737=cut
738
739sub connected {
64cdad22 740 my $self = shift @_;
741 return
742 $self->master->connected &&
743 $self->pool->connected_replicants;
2bf79155 744}
745
2bf79155 746=head2 ensure_connected
747
748Make sure all the storages are connected.
749
750=cut
751
752sub ensure_connected {
64cdad22 753 my $self = shift @_;
754 foreach my $source ($self->all_storages) {
755 $source->ensure_connected(@_);
756 }
2bf79155 757}
758
2bf79155 759=head2 limit_dialect
760
761Set the limit_dialect for all existing storages
762
763=cut
764
765sub limit_dialect {
64cdad22 766 my $self = shift @_;
767 foreach my $source ($self->all_storages) {
768 $source->limit_dialect(@_);
769 }
f3e9f010 770 return $self->master->limit_dialect;
2bf79155 771}
772
2bf79155 773=head2 quote_char
774
775Set the quote_char for all existing storages
776
777=cut
778
779sub quote_char {
64cdad22 780 my $self = shift @_;
781 foreach my $source ($self->all_storages) {
782 $source->quote_char(@_);
783 }
3fbe08e3 784 return $self->master->quote_char;
2bf79155 785}
786
2bf79155 787=head2 name_sep
788
789Set the name_sep for all existing storages
790
791=cut
792
793sub name_sep {
64cdad22 794 my $self = shift @_;
795 foreach my $source ($self->all_storages) {
796 $source->name_sep(@_);
797 }
3fbe08e3 798 return $self->master->name_sep;
2bf79155 799}
800
2bf79155 801=head2 set_schema
802
803Set the schema object for all existing storages
804
805=cut
806
807sub set_schema {
64cdad22 808 my $self = shift @_;
809 foreach my $source ($self->all_storages) {
810 $source->set_schema(@_);
811 }
2bf79155 812}
813
2bf79155 814=head2 debug
815
816set a debug flag across all storages
817
818=cut
819
820sub debug {
64cdad22 821 my $self = shift @_;
3fbe08e3 822 if(@_) {
823 foreach my $source ($self->all_storages) {
824 $source->debug(@_);
6f7344b8 825 }
64cdad22 826 }
3fbe08e3 827 return $self->master->debug;
2bf79155 828}
829
2bf79155 830=head2 debugobj
831
cea43436 832set a debug object
2bf79155 833
834=cut
835
836sub debugobj {
64cdad22 837 my $self = shift @_;
cea43436 838 return $self->master->debugobj(@_);
2bf79155 839}
840
2bf79155 841=head2 debugfh
842
cea43436 843set a debugfh object
2bf79155 844
845=cut
846
847sub debugfh {
64cdad22 848 my $self = shift @_;
cea43436 849 return $self->master->debugfh(@_);
2bf79155 850}
851
2bf79155 852=head2 debugcb
853
cea43436 854set a debug callback
2bf79155 855
856=cut
857
858sub debugcb {
64cdad22 859 my $self = shift @_;
cea43436 860 return $self->master->debugcb(@_);
2bf79155 861}
862
2bf79155 863=head2 disconnect
864
865disconnect everything
866
867=cut
868
869sub disconnect {
64cdad22 870 my $self = shift @_;
871 foreach my $source ($self->all_storages) {
872 $source->disconnect(@_);
873 }
2bf79155 874}
875
b2e4d522 876=head2 cursor_class
877
878set cursor class on all storages, or return master's
879
880=cut
881
882sub cursor_class {
883 my ($self, $cursor_class) = @_;
884
885 if ($cursor_class) {
886 $_->cursor_class($cursor_class) for $self->all_storages;
887 }
888 $self->master->cursor_class;
889}
d4daee7b 890
3244fdcc 891=head2 cursor
892
893set cursor class on all storages, or return master's, alias for L</cursor_class>
894above.
895
896=cut
897
898sub cursor {
899 my ($self, $cursor_class) = @_;
900
901 if ($cursor_class) {
902 $_->cursor($cursor_class) for $self->all_storages;
903 }
904 $self->master->cursor;
905}
906
907=head2 unsafe
908
909sets the L<DBIx::Class::Storage::DBI/unsafe> option on all storages or returns
910master's current setting
911
912=cut
913
914sub unsafe {
915 my $self = shift;
916
917 if (@_) {
918 $_->unsafe(@_) for $self->all_storages;
919 }
920
921 return $self->master->unsafe;
922}
923
924=head2 disable_sth_caching
925
926sets the L<DBIx::Class::Storage::DBI/disable_sth_caching> option on all storages
927or returns master's current setting
928
929=cut
930
931sub disable_sth_caching {
932 my $self = shift;
933
934 if (@_) {
935 $_->disable_sth_caching(@_) for $self->all_storages;
936 }
937
938 return $self->master->disable_sth_caching;
939}
940
941=head2 lag_behind_master
942
943returns the highest Replicant L<DBIx::Class::Storage::DBI/lag_behind_master>
944setting
945
946=cut
947
948sub lag_behind_master {
949 my $self = shift;
950
951 return max map $_->lag_behind_master, $self->replicants;
fd323bf1 952}
3244fdcc 953
954=head2 is_replicating
955
956returns true if all replicants return true for
957L<DBIx::Class::Storage::DBI/is_replicating>
958
959=cut
960
961sub is_replicating {
962 my $self = shift;
963
964 return (grep $_->is_replicating, $self->replicants) == ($self->replicants);
965}
966
967=head2 connect_call_datetime_setup
968
969calls L<DBIx::Class::Storage::DBI/connect_call_datetime_setup> for all storages
970
971=cut
972
973sub connect_call_datetime_setup {
974 my $self = shift;
975 $_->connect_call_datetime_setup for $self->all_storages;
976}
977
978sub _populate_dbh {
979 my $self = shift;
980 $_->_populate_dbh for $self->all_storages;
981}
982
983sub _connect {
984 my $self = shift;
985 $_->_connect for $self->all_storages;
986}
987
988sub _rebless {
989 my $self = shift;
990 $_->_rebless for $self->all_storages;
991}
992
993sub _determine_driver {
994 my $self = shift;
995 $_->_determine_driver for $self->all_storages;
996}
997
998sub _driver_determined {
999 my $self = shift;
fd323bf1 1000
3244fdcc 1001 if (@_) {
1002 $_->_driver_determined(@_) for $self->all_storages;
1003 }
1004
1005 return $self->master->_driver_determined;
1006}
1007
1008sub _init {
1009 my $self = shift;
fd323bf1 1010
3244fdcc 1011 $_->_init for $self->all_storages;
1012}
1013
1014sub _run_connection_actions {
1015 my $self = shift;
fd323bf1 1016
3244fdcc 1017 $_->_run_connection_actions for $self->all_storages;
1018}
1019
1020sub _do_connection_actions {
1021 my $self = shift;
fd323bf1 1022
3244fdcc 1023 if (@_) {
1024 $_->_do_connection_actions(@_) for $self->all_storages;
1025 }
1026}
1027
1028sub connect_call_do_sql {
1029 my $self = shift;
1030 $_->connect_call_do_sql(@_) for $self->all_storages;
1031}
1032
1033sub disconnect_call_do_sql {
1034 my $self = shift;
1035 $_->disconnect_call_do_sql(@_) for $self->all_storages;
1036}
1037
1038sub _seems_connected {
1039 my $self = shift;
1040
1041 return min map $_->_seems_connected, $self->all_storages;
1042}
1043
1044sub _ping {
1045 my $self = shift;
1046
1047 return min map $_->_ping, $self->all_storages;
1048}
1049
bbdda281 1050# not using the normalized_version, because we want to preserve
1051# version numbers much longer than the conventional xxx.yyyzzz
7da56142 1052my $numify_ver = sub {
1053 my $ver = shift;
1054 my @numparts = split /\D+/, $ver;
bbdda281 1055 my $format = '%d.' . (join '', ('%06d') x (@numparts - 1));
7da56142 1056
1057 return sprintf $format, @numparts;
1058};
fecb38cb 1059sub _server_info {
1060 my $self = shift;
1061
bbdda281 1062 if (not $self->_dbh_details->{info}) {
1063 $self->_dbh_details->{info} = (
fd323bf1 1064 reduce { $a->[0] < $b->[0] ? $a : $b }
7da56142 1065 map [ $numify_ver->($_->{dbms_version}), $_ ],
1066 map $_->_server_info, $self->all_storages
1067 )->[1];
fecb38cb 1068 }
1069
bbdda281 1070 return $self->next::method;
fecb38cb 1071}
1072
1073sub _get_server_version {
1074 my $self = shift;
1075
1076 return $self->_server_info->{dbms_version};
1077}
1078
7e38d850 1079=head1 GOTCHAS
1080
1081Due to the fact that replicants can lag behind a master, you must take care to
1082make sure you use one of the methods to force read queries to a master should
1083you need realtime data integrity. For example, if you insert a row, and then
3dd506b8 1084immediately re-read it from the database (say, by doing
1085L<< $result->discard_changes|DBIx::Class::Row/discard_changes >>)
7e38d850 1086or you insert a row and then immediately build a query that expects that row
1087to be an item, you should force the master to handle reads. Otherwise, due to
1088the lag, there is no certainty your data will be in the expected state.
1089
1090For data integrity, all transactions automatically use the master storage for
1091all read and write queries. Using a transaction is the preferred and recommended
1092method to force the master to handle all read queries.
1093
1094Otherwise, you can force a single query to use the master with the 'force_pool'
1095attribute:
1096
47d7b769 1097 my $result = $resultset->search(undef, {force_pool=>'master'})->find($pk);
7e38d850 1098
b1de1b06 1099This attribute will safely be ignored by non replicated storages, so you can use
7e38d850 1100the same code for both types of systems.
1101
1102Lastly, you can use the L</execute_reliably> method, which works very much like
1103a transaction.
1104
1105For debugging, you can turn replication on/off with the methods L</set_reliable_storage>
1106and L</set_balanced_storage>, however this operates at a global level and is not
1107suitable if you have a shared Schema object being used by multiple processes,
1108such as on a web application server. You can get around this limitation by
1109using the Schema clone method.
1110
1111 my $new_schema = $schema->clone;
1112 $new_schema->set_reliable_storage;
d4daee7b 1113
7e38d850 1114 ## $new_schema will use only the Master storage for all reads/writes while
1115 ## the $schema object will use replicated storage.
1116
a2bd3796 1117=head1 FURTHER QUESTIONS?
f5d3a5de 1118
a2bd3796 1119Check the list of L<additional DBIC resources|DBIx::Class/GETTING HELP/SUPPORT>.
2156bbdd 1120
a2bd3796 1121=head1 COPYRIGHT AND LICENSE
f5d3a5de 1122
a2bd3796 1123This module is free software L<copyright|DBIx::Class/COPYRIGHT AND LICENSE>
1124by the L<DBIx::Class (DBIC) authors|DBIx::Class/AUTHORS>. You can
1125redistribute it and/or modify it under the same terms as the
1126L<DBIx::Class library|DBIx::Class/COPYRIGHT AND LICENSE>.
f5d3a5de 1127
1128=cut
1129
c354902c 1130__PACKAGE__->meta->make_immutable;
1131
f5d3a5de 11321;