R is an open-source programming language and command-based application.  This language is a powerful visualization and analysis tool for data. R is primarily used for statistical analysis, so it lends itself well to text mining, particularly using the tm (text mining) package.

This tutorial by Seth Robins is written as a .R file. You can follow along after you have installed R.