Thus was born, ar_test_runner, a convenient plugin with a rake task to run the ActiveRecord test suites with your  code/gem/plugin load. You even can choose the ActiveRecord version and database.

Install

  gem sources -a http://gems.github.com
  sudo gem install blythedunham-ar_test_runner

Run ar_test_runner

Run all plugins and lib files against sqlite for app version

ar_test_runner DB=sqlite

Test 2.2.2 with rails_devs_for_data_integrity plugin loaded on mysql

ar_test_runner PLUGIN=rails_devs_for_data_integrity AR_DIR=/Library/Ruby/Gems/1.8/gems/activerecord-2.2.2

Rake Tasks

ar_test_runner works as a rake task, if installed as a plugin or by adding require “ar_test_runner” to the application’s Rakefile. The following example tests the applications default version of ActiveRecord with the files RAILS_ROOT/lib/my_file.rb and RAILS_ROOT/lib/my_other_file.rb loaded

rake test:activerecord:mysql FILE=lib/my_file.rb,lib/my_other_file.rb

Customize

To specify (or skip)  gems, files, dirs, and plugins ot load or build custom runs see the documentation at ar_test_runner .

Join the club! Rails Devs for Data Integrity

I am a Rails Developer and I believe in data integrity. There I said it! And look, there are lots of people in the club. Jer on Rails had an awesome post in support for foreign keys a while back.

After my talk on supercharging ActiveRecord to behave in an enterprise environment at the MySQL conference, a lot of folks were interested in how to get around the Rails ActiveRecord errors that appear when one starts deifying the Rails Way and uses foreign keys and unique indexes on the database. Well I thought about it and came up with not only a list but a yet another new plugin rails_devs_for_data_integrity to help deal with some of the errors. So when someone tells you not to use foreign keys, don’t listen and join the Rails Devs for Data Integrity! Here is how to have em, and still make pretty Rails apps.

Super list….

Unique Keys

Use validates_uniqueness_of

validates_uniqueness_of introduces a query to check unique records before insert or update, but alone doesn’t guaranty uniqueness in a multi server/multi mongrel environment. By using it conjunction with a unique key on the database, you have proper rails error messages and your safety belt to retain data integrity. In most cases when dealing with a single instance (a single user’s user name for example), I can afford to eat the overhead of the rails validates_uniqueness_of query.

Use on duplicate key update and ignore

ar-extensions 0.9.1 supports ON DUPLICATE KEY UPDATE and IGNORE for MySQL on import, save, and create (all inserts and updates). This is especially practical for import (bulk insert) where validating each record’s uniqueness would produce a lot of overhead.

Catch and Handle the Duplicate Violation Exception

I wrote a lot of custom code in models and controllers to catch MySQL duplicate key error (ActiveRecord::StatementInvalid) and handle them appropriately. Typically, I added a new error to ActiveRecord::Base.errors, which is then displayed nicely with error_messages_for in the view. Sometimes this was done often with a save_safe model method possibly aliased to save or a rescue on the controller action.

After MySQLConf I decided to write a little plugin rails_devs_for_data_integrity to convert exceptions into ActiveRecord errors (like validations do) for tables with unique and foreign keys . Its still infantile (and without tests, gasp!) but if anyone likes to find bugs, hit me up on githubs new issue tracker. If there is more than one unique key per table, you might want write some custom error handling methods.

script/plugin install git://github.com/blythedunham/rails_devs_for_data_integrity.git

 class User < ActiveRecord::Base
   handle_unique_key_violation  :user_name, :message => 'is taken"
   handle_foreign_key_violation :primary_email_id, :message => 'is not available'
 end

Will write ActiveRecord errors instead of nasty MySQL errors:

 >> user.errors.on(:user_name)
 => "association does not exist."

 >> user.errors.on(:primary_email_id)
 => "is a duplicate."

Overwrite rescue_action_in_public in ApplicationController

Its a good idea to either send the user to a pretty 404 static generic error page (fast) or write some custom code in rescue_action_in_public. One idea is to create DisplayableException and subclass any exceptions where the text can be displayed to the user. If this is thrown, show exeception.to_s, if not show a generic error.

def rescues_action_in_public(exception)
  @message = if exception.is_a?(DisplayableException)
    exception.to_s
  else
    "Sorry but an error occurred. Please contact your mommy."
  end
  render :action => 'error_page'
end

Foreign Keys

I have been using the Redhills foreign key migration plugin for a long time and haven’t had too much trouble with foreign key violations.

Trouble Deleting Records

At one point ON DELETE was not specified to SET NULL or CASCADE on many dependent columns and there was trouble deleting rows. Reindexing the database with this option was the solution. Similarly,  one could use ON UPDATE on foreign key indexes.  However, due to the way ActiveRecord works and doesn’t really update id columns, I haven’t had any issues.

Foreign Key Validation Errors

This has happened so seldom that I never worried about it. That’s what the refresh button is for! Perhaps its because most users have their own data and aren’t really modifying and deleting simultaneously. However, sure this can happen and it throws an ActiveRecord::StatementInvalid exception as with unique key violations. I would recommend the same approach as for unique keys: catch and handle the exception. I added foreign key support to the rails_devs_for_data_integrity plugin experiment. Yay!

Today I present Taking Active Record To the Next Level at the MySQL Conference and Expo! There is a lot of excitement in the Rails world due to Rails 3 merge with Merb which will provide framework agnosticism for the people. However, good, old, (sometimes not playing nice with MySQL) ActiveRecord is still the defacto despite the cool newcomers. Don’t worry. I bashed my head against the wall with it for 3 years so you don’t have to. There are lots of tips and tricks for unleashing the power of MySQL and whipping ActiveRecord into enterprise ready shape. Oh, and also included are some really cool pictures like the giraffe on the left.

script/plugin install git://github.com/zdennis/ar-extensions.git
gem install ar-extensions

While the original functionality of database agnostic ar-extensions is to import (bulk insert) many records quickly, my favorite new features for 0.9.1 are the new find and save options which allow developers to quickly customize queries without writing SQL for the MySQL database.

Find

For instance, suppose the wrong index is used to perform your favorite query. This use to mean that the developer had to dig through the logs, find the generated query, and rewrite the entire query with the correct index in SQL and execute it with ActiveRecord::Base.find_by_sql. With ar-extensions, its just another parameter to the find method. Similarly, leveraging MySQL functionality such as SQL_CACHE, HIGH PRIORITY, and LOCK IN SHARED MODE is just as easy.

Beer.find :all, :index_hint => 'USE INDEX (uk_beer_name)'
#SQL: SELECT * from `beers` USE INDEX (uk_beer_name)

Beer.find :all, :keywords => ' SQL_CACHE HIGH_PRIORITY'
#SQL: SELECT SQL_CACHE HIGH_PRIORITY * from `beers`  

Beer.find :all, :post_sql => ' FOR UPDATE', :pre_sql => '/* My little comment*/'
#SQL: /* My little comment*/ SELECT * from `beers` FOR UPDATE 

Finder SQL Exposed

And if that’s not enough to take advantage of MySQL query options, finder_sql_to_string will send the query string back and you can gsub your heart out before execution. It’s also a great to use for debugging purposes.

sql = Beer.send :finder_sql_to_string, :conditions => ['flavor like ?', 'delicious']
Beer.find_by_sql sql.gsub('WHERE', 'where /* I heart lowercase */')

Save and Create

As for save and create, the new options provide more control over database inserts and updates, especially when unique keys are involved.

Animal.create!({:name => 'Jerry Giraffe'},   n_duplicate_key_update => [:password])
#INSERT INTO animals (`name`, `fav_beer`, `password`) VALUES('Jerry Giraffe', 'Pabst', NULL) ON DUPLICATE KEY UPDATE `animals`.`password`=VALUES(`password`)

animal.save(:keywords => 'LOW_PRIORITY', :ignore => true,
            :pre_sql => "/* Now I know where this query is coming from within my Rails code!*/")
#/* Now I know where this query is coming from within my Rails code!*/ UPDATE LOW_PRIORITY IGNORE `animals` SET `fav_beer` = 'Pabst', `password` = 'frenchfry', `name` = 'Party Giraffe' WHERE `id` = 1

In addition to these spiffy new features, ar-extensions provides support for all of these:

• (new) create and save options rdoc
• (new) find options rdoc
• (new) insert_select from one table to another rdoc
• (new) find and count unions rdoc
• (new) delete options rdoc
• import (bulk insert) with synchronization rdoc
• csv export rdoc
• better finder hash support rdoc
• disabling foreign keys rdoc
• fulltext search support rdoc
• temporary table manipulation rdoc

That’s a lot of rope! If you do by chance hang yourself, please send bugs, comments and even patches to the new github issue tracker.

# Insert one copy of each book into the shopping cart. 
  CartItem.insert_select(:from => :book,
                         :select => ['books.id, ?, ?, ?, now()', @cart.to_param, 1, Time.now],
                         :into => [:book_id, :shopping_cart_id, :copies, :updated_at, :created_at]})

# GENERATED SQL example (MySQL):
# INSERT INTO `cart_items` ( `book_id`, `shopping_cart_id`, `copies`, `updated_at`, `created_at` )
# SELECT books.id, '134', 1, '2009-03-02 18:28:25', now() FROM `books`

Using the :keywords, :pre_sql, and :post_sql the  insert_select options, support all mysql options available to insert and select statements including

• IGNORE
• ON DUPLICATE KEY UPDATE
• LOW_PRIORITY
• SQL_CACHE
• DELAY

before and after comments and anything you can imagine you want to customize.

To install:

script/plugin install git://github.com/zdennis/ar-extensions.git

For more documentation, refer to  insert_select rdocs and main rdocs.