We recently worked on large-scale document classification. One of our latest software is LIBLINEAR. It can efficiently train millions of documents.
The major computational task behind support vector machines is to solve optimization problems. I am interested in large-scale numerical optimization and its applications. A nonlinear optimization software developed earlier is TRON.