Creating a Computational Linguistics College Degree?

$random_var asks: "I am an undergraduate student currently studying Bioengineering. However, I am growing more and more interested in programming and linguistics, which leads me to think that I should define my own major, Computational Linguistics [mit.edu], which google defines as 'a field concerned with the processing of natural language by computers.' When I present my proposal for this degree to the school's advising staff, I would like to have a complete list of all of the topics this major should cover. Having only little experience with computer science and engineering, I'm not sure what parts of that field I should include. Beyond the basic lower-division courses, what specific fields of computer science do you think should be emphasized in a practical undergraduate study of Computational Linguistics?"

Comments

As someone who has done some work in the field...

[Faizdog]

Computational Linguistics, or Natural Language Processing (NLP) as it was called for me, is one of the many areas that traditional Computer Science is exploring, in addition to things like biology (bioinformatics), etc.

I'd say the first two years in the major need to be very similar to the first two years in the Computer Science curriculum and last two in the humanities/linguistic area. The reason I say this is because a lot of the math, basic computer science, etc that is needed in the field will be the same as the core Comp Sci/engineering classes. However, the first two years in the humanities are very generic, and you specialize a lot later. So build up the core of Comp Sci and linguistical study early.

Then, get deeper. A lot of the NLP work is being done in Maching Learning/Data Mining classes. Make sure you take those, we had a whole class called Textual Data Mining at my university. Take algorithm design and some of the common advanced Comp Sci classes too, since a lot of the techniques are very advanced, being developed, cutting edge and will require research. Take advanced statistics classes too, much of the field is built on statistics.

NLP is a very interesting area, but I don't know if it deserves its own major yet. I would advise majoring in comp sci, with a concentration in Machine Learning/Data Mining through your technical electives. And a minor, or perhaps second major in Linguistics. I'd say minor because then you could take only the classes relevant to the field, instead of all the other stuff related to a humanities major that you may not want.

Anyway, that's my take. I did a bunch of NLP research, even getting work published as an undergrad, and I was a Computer Engineering major. The field is as such that it's so new and emerging that not much formal linguistics study is required right now, if you are a native english speaker you are probably good. But, it doesn't hurt to get a more formal background in it, that's why I suggested the minor.

A.I.

[cmarks03]

The only thing as a CSE student that pops out at me is Artificial Intelligence-related courses. Though if you ask me, the best way learn how to do something is by doing it (assuming you have taken the entry-level courses like C, etc). I'm doing an internship (co-op) right now that will help me in at least three classes I have to take still.
Also, just thinking and re-reading, some language classes would be handy. Though the elementary school english about nouns/verbs/etc will help, you'll need more if it's to process natural language.
Another thing is some data structures classes. One project in one of my data structures classes dealt with the computer making up a sentance based on a template (the "grammar") and the stuff to plug into the template (the dictionary). You're looking at the exact opposite but with a difficult to define "grammar" and a huge dictionary.
Plus anything that would help you in implimentation in software such as database usage, etc.

Re:Don't do it

[octavist]

I concur. In fact, I did what you are trying to do, complete with Engineering Open House project that conversed, and stored info in a semantic network. Then I had wonderful interviews with various NLP heavyweights (of the era). When one gentleman said, "I'm going to do everything I can to see you get an offer", I realize in retrospect that he meant, "...since you only have a Bachelor's Degree." CS, lots of graph theory and algorithms. Take a few linguistics courses on the side. What he said. Then do this in grad school.

Markov Chaining

[conJunk]

Markov Chaining, as applied to language, is really interesting.

It involves taking a canon of text (for example, the complete works of shakespeare, or every example of written english you can get your hands on, or every example of transcripts of spoken english you can get your hands on) and subjecting them to a statistical analysis of what chucks (that is, words, phrases, what have you) are likely to follow which other chunks.

while the outputs tend to make little sense, it is "interesting" to see what kinds of "statistically probably" examples of language a computer can make based on the training (input) you've given it

Re:Is a separate major really necessary?

[Dr. Spork]

I agree with the parent. If I were a potential future employer or if I sat on an admissions committe for grad school, I'd look at your "custom degree" and say this to myself:

"Here's a kid who wanted to get out of having to take the hard CS classes, so he made up a major that sounds sexy and then slacked off. He just couldn't hack the real CS program."

Now, I'm not saying that this is you. If this would be a mistaken perception of what you're doing, I advise you to not invite the mistake, prove to everyone you can satisfy the requirements of the CS degree, and that you're motivated to do this extra work on linguistics. Then you'll look good. And, you'll have a non-hokey degree that might help you get a job even if you one day decide to not do language processing.