ruby_parser version 3.7.0 has been released!

Published 2015-05-28 @ 15:04

ruby_parser (RP) is a ruby parser written in pure ruby (utilizing racc–which does by default use a C extension). RP’s output is the same as ParseTree’s output: s-expressions using ruby’s arrays and base types.

As an example:

def conditional1 arg1
  return 1 if arg1 == 0
  return 0
end

becomes:

s(:defn, :conditional1, s(:args, :arg1),
  s(:if,
    s(:call, s(:lvar, :arg1), :==, s(:lit, 0)),
    s(:return, s(:lit, 1)),
    nil),
  s(:return, s(:lit, 0)))

Tested against 801,039 files from the latest of all rubygems (as of 2013-05):

• 1.8 parser is at 99.9739% accuracy, 3.651 sigma
• 1.9 parser is at 99.9940% accuracy, 4.013 sigma
• 2.0 parser is at 99.9939% accuracy, 4.008 sigma

Changes:

3.7.0 / 2015-05-28

• 2 major enhancements:

  • Added preliminary support for ruby 2.2 syntax.
  • Now writing all 2.x parsers from one source, generating racc files.

• 1 minor enhancement:

  • Added RubyLexer#process_label and hooked it up to “x”: and ‘x’: productions.

• 4 bug fixes:

  • Fixed handling of block_args to be consistent across all parse versions.
  • Fixed lexing of label assoc args w/ newlines in between k/v. (jeremyf)
  • Fixed lexing of x?’‘:y for ruby22 (not a label). (presidentbeef)
  • clear and restore cmdarg stack around def args and body.
• home: https://github.com/seattlerb/ruby_parser
• bugs: https://github.com/seattlerb/ruby_parser/issues
• rdoc: http://docs.seattlerb.org/ruby_parser