1 package DBIx::Class::Ordered;
4 use base qw( DBIx::Class );
6 use List::Util 'first';
11 DBIx::Class::Ordered - Modify the position of objects in an ordered list.
15 Create a table for your ordered data.
18 item_id INTEGER PRIMARY KEY AUTOINCREMENT,
20 position INTEGER NOT NULL
23 Optionally, add one or more columns to specify groupings, allowing you
24 to maintain independent ordered lists within one table:
27 item_id INTEGER PRIMARY KEY AUTOINCREMENT,
29 position INTEGER NOT NULL,
30 group_id INTEGER NOT NULL
36 item_id INTEGER PRIMARY KEY AUTOINCREMENT,
38 position INTEGER NOT NULL,
39 group_id INTEGER NOT NULL,
40 other_group_id INTEGER NOT NULL
43 In your Schema or DB class add "Ordered" to the top
44 of the component list.
46 __PACKAGE__->load_components(qw( Ordered ... ));
48 Specify the column that stores the position number for
52 __PACKAGE__->position_column('position');
54 If you are using one grouping column, specify it as follows:
56 __PACKAGE__->grouping_column('group_id');
58 Or if you have multiple grouping columns:
60 __PACKAGE__->grouping_column(['group_id', 'other_group_id']);
62 That's it, now you can change the position of your objects.
67 my $item = My::Item->create({ name=>'Matt S. Trout' });
68 # If using grouping_column:
69 my $item = My::Item->create({ name=>'Matt S. Trout', group_id=>1 });
71 my $rs = $item->siblings();
72 my @siblings = $item->siblings();
75 $sibling = $item->first_sibling();
76 $sibling = $item->last_sibling();
77 $sibling = $item->previous_sibling();
78 $sibling = $item->next_sibling();
80 $item->move_previous();
84 $item->move_to( $position );
85 $item->move_to_group( 'groupname' );
86 $item->move_to_group( 'groupname', $position );
87 $item->move_to_group( {group_id=>'groupname', 'other_group_id=>'othergroupname'} );
88 $item->move_to_group( {group_id=>'groupname', 'other_group_id=>'othergroupname'}, $position );
92 This module provides a simple interface for modifying the ordered
93 position of DBIx::Class objects.
97 All of the move_* methods automatically update the rows involved in
98 the query. This is not configurable and is due to the fact that if you
99 move a record it always causes other records in the list to be updated.
103 =head2 position_column
105 __PACKAGE__->position_column('position');
107 Sets and retrieves the name of the column that stores the
108 positional value of each record. Defaults to "position".
112 __PACKAGE__->mk_classdata( 'position_column' => 'position' );
114 =head2 grouping_column
116 __PACKAGE__->grouping_column('group_id');
118 This method specifies a column to limit all queries in
119 this module by. This effectively allows you to have multiple
120 ordered lists within the same table.
124 __PACKAGE__->mk_classdata( 'grouping_column' );
126 =head2 null_position_value
128 __PACKAGE__->null_position_value(undef);
130 This method specifies a value of L</position_column> which B<would
131 never be assigned to a row> during normal operation. When
132 a row is moved, its position is set to this value temporarily, so
133 that any unique constraints can not be violated. This value defaults
134 to 0, which should work for all cases except when your positions do
139 __PACKAGE__->mk_classdata( 'null_position_value' => 0 );
143 my $rs = $item->siblings();
144 my @siblings = $item->siblings();
146 Returns an B<ordered> resultset of all other objects in the same
147 group excluding the one you called it on.
149 The ordering is a backwards-compatibility artifact - if you need
150 a resultset with no ordering applied use C<_siblings>
155 return $self->_siblings->search ({}, { order_by => $self->position_column } );
158 =head2 previous_siblings
160 my $prev_rs = $item->previous_siblings();
161 my @prev_siblings = $item->previous_siblings();
163 Returns a resultset of all objects in the same group
164 positioned before the object on which this method was called.
167 sub previous_siblings {
169 my $position_column = $self->position_column;
170 my $position = $self->get_column ($position_column);
171 return ( defined $position
172 ? $self->_siblings->search ({ $position_column => { '<', $position } })
179 my $next_rs = $item->next_siblings();
180 my @next_siblings = $item->next_siblings();
182 Returns a resultset of all objects in the same group
183 positioned after the object on which this method was called.
188 my $position_column = $self->position_column;
189 my $position = $self->get_column ($position_column);
190 return ( defined $position
191 ? $self->_siblings->search ({ $position_column => { '>', $position } })
196 =head2 previous_sibling
198 my $sibling = $item->previous_sibling();
200 Returns the sibling that resides one position back. Returns 0
201 if the current object is the first one.
205 sub previous_sibling {
207 my $position_column = $self->position_column;
209 my $psib = $self->previous_siblings->search(
211 { rows => 1, order_by => { '-desc' => $position_column } },
214 return defined $psib ? $psib : 0;
219 my $sibling = $item->first_sibling();
221 Returns the first sibling object, or 0 if the first sibling
228 my $position_column = $self->position_column;
230 my $fsib = $self->previous_siblings->search(
232 { rows => 1, order_by => { '-asc' => $position_column } },
235 return defined $fsib ? $fsib : 0;
240 my $sibling = $item->next_sibling();
242 Returns the sibling that resides one position forward. Returns 0
243 if the current object is the last one.
249 my $position_column = $self->position_column;
250 my $nsib = $self->next_siblings->search(
252 { rows => 1, order_by => { '-asc' => $position_column } },
255 return defined $nsib ? $nsib : 0;
260 my $sibling = $item->last_sibling();
262 Returns the last sibling, or 0 if the last sibling is this
269 my $position_column = $self->position_column;
270 my $lsib = $self->next_siblings->search(
272 { rows => 1, order_by => { '-desc' => $position_column } },
275 return defined $lsib ? $lsib : 0;
278 # an optimized method to get the last sibling position value without inflating a result object
279 sub _last_sibling_posval {
281 my $position_column = $self->position_column;
283 my $cursor = $self->next_siblings->search(
285 { rows => 1, order_by => { '-desc' => $position_column }, select => $position_column },
288 my ($pos) = $cursor->next;
294 $item->move_previous();
296 Swaps position with the sibling in the position previous in
297 the list. Returns 1 on success, and 0 if the object is
298 already the first one.
304 return $self->move_to ($self->_position - 1);
311 Swaps position with the sibling in the next position in the
312 list. Returns 1 on success, and 0 if the object is already
313 the last in the list.
319 return 0 unless defined $self->_last_sibling_posval; # quick way to check for no more siblings
320 return $self->move_to ($self->_position + 1);
327 Moves the object to the first position in the list. Returns 1
328 on success, and 0 if the object is already the first.
333 return shift->move_to( 1 );
340 Moves the object to the last position in the list. Returns 1
341 on success, and 0 if the object is already the last one.
347 my $last_posval = $self->_last_sibling_posval;
349 return 0 unless defined $last_posval;
351 return $self->move_to( $self->_position_from_value ($last_posval) );
356 $item->move_to( $position );
358 Moves the object to the specified position. Returns 1 on
359 success, and 0 if the object is already at the specified
365 my( $self, $to_position ) = @_;
366 return 0 if ( $to_position < 1 );
368 my $position_column = $self->position_column;
371 if ($is_txn = $self->result_source->schema->storage->transaction_depth) {
372 # Reload position state from storage
373 # The thinking here is that if we are in a transaction, it is
374 # *more likely* the object went out of sync due to resultset
375 # level shenanigans. Instead of always reloading (slow) - go
376 # ahead and hand-hold only in the case of higher layers
377 # requesting the safety of a txn
381 ( $self->result_source
383 ->search($self->_storage_ident_condition, { rows => 1, columns => $position_column })
386 )[0] || $self->throw_exception(
387 sprintf "Unable to locate object '%s' in storage - object went ouf of sync...?",
391 delete $self->{_dirty_columns}{$position_column};
393 elsif ($self->is_column_changed ($position_column) ) {
394 # something changed our position, we need to know where we
395 # used to be - use the stashed value
396 $self->store_column($position_column, delete $self->{_column_data_in_storage}{$position_column});
397 delete $self->{_dirty_columns}{$position_column};
400 my $from_position = $self->_position;
402 if ( $from_position == $to_position ) { # FIXME this will not work for non-numeric order
406 my $guard = $is_txn ? undef : $self->result_source->schema->txn_scope_guard;
408 my ($direction, @between);
409 if ( $from_position < $to_position ) {
411 @between = map { $self->_position_value ($_) } ( $from_position + 1, $to_position );
415 @between = map { $self->_position_value ($_) } ( $to_position, $from_position - 1 );
418 my $new_pos_val = $self->_position_value ($to_position); # record this before the shift
420 # we need to null-position the moved row if the position column is part of a constraint
421 if (grep { $_ eq $position_column } ( map { @$_ } (values %{{ $self->result_source->unique_constraints }} ) ) ) {
422 $self->_ordered_internal_update({ $position_column => $self->null_position_value });
425 $self->_shift_siblings ($direction, @between);
426 $self->_ordered_internal_update({ $position_column => $new_pos_val });
428 $guard->commit if $guard;
434 $item->move_to_group( $group, $position );
436 Moves the object to the specified position of the specified
437 group, or to the end of the group if $position is undef.
438 1 is returned on success, and 0 is returned if the object is
439 already at the specified position of the specified group.
441 $group may be specified as a single scalar if only one
442 grouping column is in use, or as a hashref of column => value pairs
443 if multiple grouping columns are in use.
448 my( $self, $to_group, $to_position ) = @_;
450 # if we're given a single value, turn it into a hashref
451 unless (ref $to_group eq 'HASH') {
452 my @gcols = $self->_grouping_columns;
454 $self->throw_exception ('Single group supplied for a multi-column group identifier') if @gcols > 1;
455 $to_group = {$gcols[0] => $to_group};
458 my $position_column = $self->position_column;
460 return 0 if ( defined($to_position) and $to_position < 1 );
462 # check if someone changed the _grouping_columns - this will
463 # prevent _is_in_group working, so we need to restore the
464 # original stashed values
465 for ($self->_grouping_columns) {
466 if ($self->is_column_changed ($_)) {
467 $self->store_column($_, delete $self->{_column_data_in_storage}{$_});
468 delete $self->{_dirty_columns}{$_};
472 if ($self->_is_in_group ($to_group) ) {
474 if (defined $to_position) {
475 $ret = $self->move_to ($to_position);
481 my $guard = $self->result_source->schema->txn_scope_guard;
483 # Move to end of current group to adjust siblings
486 $self->set_inflated_columns({ %$to_group, $position_column => undef });
487 my $new_group_last_posval = $self->_last_sibling_posval;
488 my $new_group_last_position = $self->_position_from_value (
489 $new_group_last_posval
492 if ( not defined($to_position) or $to_position > $new_group_last_position) {
494 $position_column => $new_group_last_position
495 ? $self->_next_position_value ( $new_group_last_posval )
496 : $self->_initial_position_value
500 my $bumped_pos_val = $self->_position_value ($to_position);
501 my @between = map { $self->_position_value ($_) } ($to_position, $new_group_last_position);
502 $self->_shift_siblings (1, @between); #shift right
503 $self->set_column( $position_column => $bumped_pos_val );
506 $self->_ordered_internal_update;
515 Overrides the DBIC insert() method by providing a default
516 position number. The default will be the number of rows in
517 the table +1, thus positioning the new record at the last position.
523 my $position_column = $self->position_column;
525 unless ($self->get_column($position_column)) {
526 my $lsib_posval = $self->_last_sibling_posval;
528 $position_column => (defined $lsib_posval
529 ? $self->_next_position_value ( $lsib_posval )
530 : $self->_initial_position_value
535 return $self->next::method( @_ );
540 Overrides the DBIC update() method by checking for a change
541 to the position and/or group columns. Movement within a
542 group or to another group is handled by repositioning
543 the appropriate siblings. Position defaults to the end
544 of a new group if it has been changed to undef.
551 # this is set by _ordered_internal_update()
552 return $self->next::method(@_) if $self->result_source->schema->{_ORDERED_INTERNAL_UPDATE};
555 $self->set_inflated_columns($upd) if $upd;
557 my $position_column = $self->position_column;
558 my @group_columns = $self->_grouping_columns;
560 # see if the order is already changed
561 my $changed_ordering_cols = { map { $_ => $self->get_column($_) } grep { $self->is_column_changed($_) } ($position_column, @group_columns) };
563 # nothing changed - short circuit
564 if (! keys %$changed_ordering_cols) {
565 return $self->next::method( undef, @_ );
567 elsif (defined first { exists $changed_ordering_cols->{$_} } @group_columns ) {
568 $self->move_to_group(
569 # since the columns are already re-set the _grouping_clause is correct
570 # move_to_group() knows how to get the original storage values
571 { $self->_grouping_clause },
573 # The FIXME bit contradicts the documentation: POD states that
574 # when changing groups without supplying explicit positions in
575 # move_to_group(), we push the item to the end of the group.
576 # However when I was rewriting this, the position from the old
577 # group was clearly passed to the new one
578 # Probably needs to go away (by ribasushi)
579 (exists $changed_ordering_cols->{$position_column}
580 ? $changed_ordering_cols->{$position_column} # means there was a position change supplied with the update too
581 : $self->_position # FIXME! (replace with undef)
586 $self->move_to($changed_ordering_cols->{$position_column});
594 Overrides the DBIC delete() method by first moving the object
595 to the last position, then deleting it, thus ensuring the
596 integrity of the positions.
603 my $guard = $self->result_source->schema->txn_scope_guard;
607 $self->next::method( @_ );
614 # add the current position/group to the things we track old values for
615 sub _track_storage_value {
616 my ($self, $col) = @_;
617 return $self->next::method($col) || defined first { $_ eq $col } ($self->position_column, $self->_grouping_columns);
620 =head1 METHODS FOR EXTENDING ORDERED
622 You would want to override the methods below if you use sparse
623 (non-linear) or non-numeric position values. This can be useful
624 if you are working with preexisting non-normalised position data,
625 or if you need to work with materialized path columns.
627 =head2 _position_from_value
629 my $num_pos = $item->_position_from_value ( $pos_value )
631 Returns the B<absolute numeric position> of an object with a B<position
632 value> set to C<$pos_value>. By default simply returns C<$pos_value>.
635 sub _position_from_value {
636 my ($self, $val) = @_;
638 return 0 unless defined $val;
640 # #the right way to do this
641 # return $self -> _group_rs
642 # -> search({ $self->position_column => { '<=', $val } })
648 =head2 _position_value
650 my $pos_value = $item->_position_value ( $pos )
652 Returns the B<value> of L</position_column> of the object at numeric
653 position C<$pos>. By default simply returns C<$pos>.
656 sub _position_value {
657 my ($self, $pos) = @_;
659 # #the right way to do this (not optimized)
660 # my $position_column = $self->position_column;
661 # return $self -> _group_rs
662 # -> search({}, { order_by => $position_column })
663 # -> slice ( $pos - 1)
665 # -> get_column ($position_column);
670 =head2 _initial_position_value
672 __PACKAGE__->_initial_position_value(0);
674 This method specifies a B<value> of L</position_column> which is assigned
675 to the first inserted element of a group, if no value was supplied at
676 insertion time. All subsequent values are derived from this one by
677 L</_next_position_value> below. Defaults to 1.
681 __PACKAGE__->mk_classdata( '_initial_position_value' => 1 );
683 =head2 _next_position_value
685 my $new_value = $item->_next_position_value ( $position_value )
687 Returns a position B<value> that would be considered C<next> with
688 regards to C<$position_value>. Can be pretty much anything, given
689 that C<< $position_value < $new_value >> where C<< < >> is the
690 SQL comparison operator (usually works fine on strings). The
691 default method expects C<$position_value> to be numeric, and
692 returns C<$position_value + 1>
695 sub _next_position_value {
699 =head2 _shift_siblings
701 $item->_shift_siblings ($direction, @between)
703 Shifts all siblings with B<positions values> in the range @between
704 (inclusive) by one position as specified by $direction (left if < 0,
705 right if > 0). By default simply increments/decrements each
706 L</position_column> value by 1, doing so in a way as to not violate
707 any existing constraints.
709 Note that if you override this method and have unique constraints
710 including the L</position_column> the shift is not a trivial task.
711 Refer to the implementation source of the default method for more
715 sub _shift_siblings {
716 my ($self, $direction, @between) = @_;
717 return 0 unless $direction;
719 my $position_column = $self->position_column;
722 if ($direction < 0) {
731 my $shift_rs = $self->_group_rs-> search ({ $position_column => { -between => \@between } });
733 # some databases (sqlite, pg, perhaps others) are dumb and can not do a
734 # blanket increment/decrement without violating a unique constraint.
735 # So what we do here is check if the position column is part of a unique
736 # constraint, and do a one-by-one update if this is the case.
737 my $rsrc = $self->result_source;
739 # set in case there are more cascades combined with $rs->update => $rs_update_all overrides
740 local $rsrc->schema->{_ORDERED_INTERNAL_UPDATE} = 1;
741 my @pcols = $rsrc->primary_columns;
743 first { $_ eq $position_column } ( map { @$_ } (values %{{ $rsrc->unique_constraints }} ) )
745 my $clean_rs = $rsrc->resultset;
747 for ( $shift_rs->search (
748 {}, { order_by => { "-$ord", $position_column }, select => [$position_column, @pcols] }
751 $clean_rs->find(@$_)->update ({ $position_column => $pos + ( ($op eq '+') ? 1 : -1 ) });
755 $shift_rs->update ({ $position_column => \ "$position_column $op 1" } );
760 # This method returns a resultset containing all members of the row
761 # group (including the row itself).
764 return $self->result_source->resultset->search({$self->_grouping_clause()});
767 # Returns an unordered resultset of all objects in the same group
768 # excluding the object you called this method on.
771 my $position_column = $self->position_column;
773 return defined ($pos = $self->get_column($position_column))
774 ? $self->_group_rs->search(
775 { $position_column => { '!=' => $pos } },
781 # Returns the B<absolute numeric position> of the current object, with the
782 # first object being at position 1, its sibling at position 2 and so on.
785 return $self->_position_from_value ($self->get_column ($self->position_column) );
788 # This method returns one or more name=>value pairs for limiting a search
789 # by the grouping column(s). If the grouping column is not defined then
790 # this will return an empty list.
791 sub _grouping_clause {
793 return map { $_ => $self->get_column($_) } $self->_grouping_columns();
796 # Returns a list of the column names used for grouping, regardless of whether
797 # they were specified as an arrayref or a single string, and returns ()
798 # if there is no grouping.
799 sub _grouping_columns {
801 my $col = $self->grouping_column();
802 if (ref $col eq 'ARRAY') {
811 # Returns true if the object is in the group represented by hashref $other
813 my ($self, $other) = @_;
814 my $current = {$self->_grouping_clause};
816 no warnings qw/uninitialized/;
819 join ("\x00", sort keys %$current)
821 join ("\x00", sort keys %$other)
823 for my $key (keys %$current) {
824 return 0 if $current->{$key} ne $other->{$key};
829 # This is a short-circuited method, that is used internally by this
830 # module to update positioning values in isolation (i.e. without
831 # triggering any of the positioning integrity code).
833 # Some day you might get confronted by datasets that have ambiguous
834 # positioning data (e.g. duplicate position values within the same group,
835 # in a table without unique constraints). When manually fixing such data
836 # keep in mind that you can not invoke L<DBIx::Class::Row/update> like
837 # you normally would, as it will get confused by the wrong data before
838 # having a chance to update the ill-defined row. If you really know what
839 # you are doing use this method which bypasses any hooks introduced by
841 sub _ordered_internal_update {
843 local $self->result_source->schema->{_ORDERED_INTERNAL_UPDATE} = 1;
844 return $self->update (@_);
853 =head2 Resultset Methods
855 Note that all Insert/Create/Delete overrides are happening on
856 L<DBIx::Class::Row> methods only. If you use the
857 L<DBIx::Class::ResultSet> versions of
858 L<update|DBIx::Class::ResultSet/update> or
859 L<delete|DBIx::Class::ResultSet/delete>, all logic present in this
860 module will be bypassed entirely (possibly resulting in a broken
861 order-tree). Instead always use the
862 L<update_all|DBIx::Class::ResultSet/update_all> and
863 L<delete_all|DBIx::Class::ResultSet/delete_all> methods, which will
864 invoke the corresponding L<row|DBIx::Class::Row> method on every
865 member of the given resultset.
867 =head2 Race Condition on Insert
869 If a position is not specified for an insert, a position
870 will be chosen based either on L</_initial_position_value> or
871 L</_next_position_value>, depending if there are already some
872 items in the current group. The space of time between the
873 necessary selects and insert introduces a race condition.
874 Having unique constraints on your position/group columns,
875 and using transactions (see L<DBIx::Class::Storage/txn_do>)
876 will prevent such race conditions going undetected.
878 =head2 Multiple Moves
880 If you have multiple same-group result objects already loaded from storage,
881 you need to be careful when executing C<move_*> operations on them:
882 without a L</position_column> reload the L</_position_value> of the
883 "siblings" will be out of sync with the underlying storage.
885 Starting from version C<0.082800> DBIC will implicitly perform such
886 reloads when the C<move_*> happens as a part of a transaction
887 (a good example of such situation is C<< $ordered_resultset->delete_all >>).
889 If it is not possible for you to wrap the entire call-chain in a transaction,
890 you will need to call L<DBIx::Class::Row/discard_changes> to get an object
891 up-to-date before proceeding, otherwise undefined behavior will result.
893 =head2 Default Values
895 Using a database defined default_value on one of your group columns
896 could result in the position not being assigned correctly.
898 =head1 FURTHER QUESTIONS?
900 Check the list of L<additional DBIC resources|DBIx::Class/GETTING HELP/SUPPORT>.
902 =head1 COPYRIGHT AND LICENSE
904 This module is free software L<copyright|DBIx::Class/COPYRIGHT AND LICENSE>
905 by the L<DBIx::Class (DBIC) authors|DBIx::Class/AUTHORS>. You can
906 redistribute it and/or modify it under the same terms as the
907 L<DBIx::Class library|DBIx::Class/COPYRIGHT AND LICENSE>.