Slashdot Mirror


Using Machine Learning To Find a Better Job

An anonymous reader writes Artificial intelligence is gaining popularity in startups, with efforts ranging from virtual assistants to deep-learning approaches to business. An MIT Media Lab spinout called Beansprock is using natural language processing and machine learning to scour job listings for good matches for engineers and developers. The software breaks down users' skills and maps them to its understanding of open positions at companies. The site focuses on Boston-area jobs for now, but could expand if it's successful.

34 of 55 comments (clear)

  1. Let me translate by Torp · · Score: 2

    They've automated the work of the drones that spam my linkedin profile after matching keywords and NOT reading anything in the free form text?

    --
    I apologize for the lack of a signature.
    1. Re:Let me translate by Anonymous Coward · · Score: 3, Insightful

      The unaddressed problem is that there is never any discernable relationship between the advertised job and the actual job - nor any relationship between the resume of the job seeker and the actual person...

    2. Re:Let me translate by umghhh · · Score: 1

      this is a black and white vision that would make any geek proud. The thing is - there is a relationship but it is not direct and straightforward. It reminds me of an Inverted Pendulum or rather a set of those to be held up just by moving their only support point.

    3. Re:Let me translate by FooAtWFU · · Score: 1

      Nor is there any direct relationship between the recruiter who's emailing you and your resume. Place key information about your career objectives (e.g. "i want you to get me a visa to work in $location") within the first paragraph and watch it be gleefully ignored, not just by the usual spammer suspects but by a variety of guys with a coherent pitch and several major tech shops like Amazon, Facebook, et cetera. :(

      --
      The World Wide Web is dying. Soon, we shall have only the Internet.
  2. a bit of history by Anonymous Coward · · Score: 2, Interesting

    Look up FlipDog, a spinout of the WhizBang startup in 2001.
    Got obsorbed by Monster.com.
    Had the same description.

    1. Re:a bit of history by oodaloop · · Score: 1

      Man, I loved Flipdog. I only got a few job recommendations from it at a time, but they were all spot on. Monster's recommendations are worthless.

      --
      Tic-Tac-Toe, Global Thermonuclear War, and relationships all have the same winning move.
  3. Re:Best way to get a tech job by Anonymous Coward · · Score: 1

    On a serious note, I'm wondering when the Tech Industry will realize Obama's Executive Amnesty means hundreds of thousands of H1B's can declare themselves illegal immigrants and become American Citizens.

    All those knowledge and skill containers deciding to go contracting for themselves, or forming their own companies, every last one of them arguing that the contracts they signed were not binding because they were signed under duress or in a foreign country or to a separate legal entitiy.

    Wouldn't that be a bitch?

    Also, obigatory; you can find a job with a spork, too.

  4. The death of humanism? by EzInKy · · Score: 1

    I don't know, and perhaps it isn't so.
    But the more machines control our gates,
    The less we humans can control our fates.
    But into the future we go!

    --
    Time is what keeps everything from happening all at once.
  5. So by Anonymous Coward · · Score: 1

    The next step will be to reverse the process and fire the hiring department?

  6. depends on the requirements of the position... by Anonymous Coward · · Score: 2, Funny

    ... here in Europe (Germany and Austria) those requirements usually look like a letter to Santa Claus...

    1. Re:depends on the requirements of the position... by __aaclcg7560 · · Score: 3, Funny

      Dear Santa,

      We need someone who has five years of experience in a new technology that came out six months ago. We can only pay in milk and cookies. Please send ASAP!

      Love,

      HR Dept.

  7. Mapping lies to lies... by tommeke100 · · Score: 3, Interesting

    Crap in -> Crap out.
    But seriously, don't the common job sites do this already? I'm pretty sure a Monster; GlassDoor or LinkedIn already have departments working on better matching algorithms ( using NLP, supervised or un-supervised machine learning).

    1. Re:Mapping lies to lies... by fastgriz · · Score: 1

      I must be using it wrong then because Glassdoor sends me dozens of irrelevant job listings every day,

    2. Re:Mapping lies to lies... by DigiShaman · · Score: 1

      Which is interesting, but I rarely get hits on Linked In (like twice a year if I'm lucky) despite all my associations and resume/skillsets. Then again, I don't have a picture uploaded either. I'm seriously wondering if that's the problem on Linked In. I'm just a normal looking dude that prefers not to have his portrait cached on the Internet. I guess I'm funny that way, but there you.

      --
      Life is not for the lazy.
  8. So let me get this straigh by codeButcher · · Score: 1

    In other words, they've replaced the keyword-matching recruitment agent with a script? Way to go!

    OK, I'm off to read the article now. Or at least the summary.

    --
    Free, as in your money being freed from the confines of your account.
    1. Re:So let me get this straigh by DigiShaman · · Score: 1

      Yo Dog! I've got a scripted machine that can recruiting other machines that can script.

      --
      Life is not for the lazy.
    2. Re:So let me get this straigh by LifesABeach · · Score: 1

      I'm beginning to wonder if long term strategies are under valued. This short term stuff acts more like pestilence than prosperity.

  9. Read about this and LOL'd by GameboyRMH · · Score: 1

    Yeah, the people who need help getting jobs most are hipsters in the world's top startup hotspots. Great work, guys.

    --
    "When information is power, privacy is freedom" - Jah-Wren Ryel
  10. job search / response by NynexNinja · · Score: 2

    I wrote a machine learning program that did when dice.com came online around 1990. I still use it today and it searches jobs (or any posting) on craigslist, monster, dice.com, hotjobs. It looks for keyword pattern matches in the job title, job description, etc, to give a score to a job posting, then if the job scores past a threshold, it will send a cover letter and email to the job. some of the most advanced features is that it will auto-generate sentences in the cover letter and/or job description depending on what it says in the job posting.

    1. Re:job search / response by LifesABeach · · Score: 1

      I think you might want to check your DOS Visual Basic for 1990 program it may be dated.

    2. Re:job search / response by toddestan · · Score: 1

      Will it also go to the interview for you too? I'd probably want to double check what it is going to do before firing off a job application. But then again if you never hear back for 99% of them, that's no different than doing it the manual way I guess.

  11. MIT Media Lab by bluegutang · · Score: 2

    Interesting that this comes from MIT Media Lab - where you can find job descriptions like the following:

    2. UNDEFINED DISCIPLINE

    The Media Lab is a cross-disciplinary research organization focusing on the invention of new media technologies that radically improve the ways people live, learn, work, and play.

    We are seeking a new kind of early career faculty member, not defined by discipline, rather by his or her unique and iconoclastic experience, style, and points of view. You can be a designer, inventor, scientist, or scholar – any combination – as long as you make things that matter. Impact is key.

    This means somebody with at least these three sets of characteristics:
    1) Being deeply versed in a minimum of two fields, preferably not ones normally juxtaposed;
    2) Being an orthogonal and counter-intuitive thinker, even a misfit within normal structures;
    3) Having a fearless personality, boundless optimism, and desire to change the world.

    Any disciplines apply as long as their confluence shows promise of solving big, difficult, and long-term problems. And, most importantly, candidates must explain why their work really can only be done at the Media Lab. We prefer candidates not be similar to our existing faculty. We welcome applicants who have never considered academic careers. If you fit into typical academia, this is probably not the job for you.

    The position has no specific degree requirement. Instead, candidates must show evidence of engineering accomplishment, scientific achievement, design innovation or artistic accomplishment. We are looking for a strong mix of invention, discovery and expression.

    Applications should consist of one URL—the web site can be designed in whatever manner best characterizes the candidate’s unique qualifications. Web site should include a CV or link to a CV.

    I wanted to nominate David Icke :)

  12. Re:Best way to get a tech job by DigiShaman · · Score: 1

    By design. This is to create a permanent underclass in America. The only thing keeping this in play by the tech industry is the all the people jockeying for one of two positions; the haves and have-nots. At least the Indian's understand the caste system. For the rest of us, welcome to the "new normal".

    --
    Life is not for the lazy.
  13. now if HR would *write* good postings by Anonymous Coward · · Score: 1

    One of the biggest problems is finding someone in HR who is willing to actually collaborate with the appropriate (knowledgable) people to craft a good positing. If conventional "I" can't read postings and figure out what the real job is about, then AI has no prayer of sussing out good patterns. I have done NLP and do ML on a regular basis -- there's no magic there. If the results are magical then your AI is locking onto nonsense inputs. As the data piles become ever larger, it becomes more common that any comparison you want to make is significant -- this leads to tremendous temptations for result cherry-picking. It's quite possible that a NLP-ML system could lock onto the quality of the grammar posting. I suppose it reflects on the company if they have high or low quality office staff in HR to manage the mechanics of posting jobs; but does that mean the job will be a better fit?

    1. Re:now if HR would *write* good postings by Ronin+Developer · · Score: 1

      This wouldn't stop someone from "tweaking" the job description that was carefully drafted in the first place. I see this all the time - job descriptions from multiple, usually, offshore, agencies and recruiters with minor differences. The tweaks and grammar are so bad that when combined with their lack of US geography so poor (CA or WA is thousands of miles from my home - without company jet, it's not exactly commuting distance), that I simply laugh at them.

      I want to receive honest job descriptions that match MY criteria from a job site. Then I want a list of agencies (job seeker ranked) and authorized to represent that position with contact info, rate info, etc. so I can decide who I want to work with in my search. Sorta like "Angie's List" for job hunters.

      I would enjoy building a business around such a system.

  14. This is just part of the equation by Ronin+Developer · · Score: 1

    and, just one step in the right direction. But, it does mean being locked into a single job site or agency.

    For me, a bigger issue is getting all the job descriptions (via email) that sound similar...but are being represented by multiple, usually, offshore, agencies. There are minor differences in the job descriptions that make it hard to know for sure they represent the same position. And, they don't like to tell you who the potential employer is UNTIL you sell them your first born and drink demon blood. They ALL want the right to represent you. Please be careful who you bargain with.. If you go with another agency for the same position (maybe offering a better rate) after they have submitted your resume to the potential employer, you will either not get the position or be locked in with the first one you gave your resume to. Hiring companies don't want to deal with the hassle of sorting out who gets the commission. In those situations, you lose.

    Unscrupulous agencies will blast all resumes in their database that might fit a position in the hopes of being the first one in the door. You can be screwed without even knowing it if they have obtained your resume and submitted without your knowledge. They hope the employer sees one they like and calls them. Then, they reach out to you. It's one reason why automation is now used to sift through CVs and job applications with many finding their way to the bitbucket without ever being seen by a human. They get hundreds (maybe thousands) of resumes submitted electronically. You need to be standout. Being unique is one way to make it past that first cut. If not unique, you lose.

    I have come view recruiters with a critical mindset after having dealt with some of the ilk that's out there. As a result, I keep a list of recruiters and agencies, gathered over the years, with who I trust to represent me well. There ARE good, reputable recruiters and agencies out there. Yes, I they are in the business of making money. And, I am very happy to help them do that if they work for me and help me gain employment on terms I prefer. This strategy, hopefully, prevents my CV from being rejected without human action first.

  15. Now if only companies that are hiring ... by rnturn · · Score: 1

    ... would employ this software in their HR departments to better match prospective employees who've sent their resumes into the company to job openings that would actually be appropriate. I can't remember how many times I've received an email from a company that has my resume on file about a job that would be a "great match" only to read on and discover that the Venn diagram of the position's "gotta have" requirements, previous experiences, and technologies and those listed on my resume don't intersect. At all. I'm sure those companies eventually find someone to fill those roles but they'd find their ideal candidate a lot faster if they were doing a better job with their keyword searches. (Serious... is it really that difficult to set up an ATS?) Maybe MIT's work will help solve this problem for those companies. Or HR departments could stop trying to insulate the hiring managers from the hiring process so that boneheaded notices like the ones I received aren't being sent out. And making the company look completely clueless.

    --
    CUR ALLOC 20195.....5804M
  16. Not enough experience... by __aaclcg7560 · · Score: 1

    Does machine learning overcome the HR requirement to have five years of experience in a technology that just came out six months ago?

  17. Re:Useless by __aaclcg7560 · · Score: 1

    Automation will kill 99% of all jobs in the near future while in the present outsourcing and "efficiency directives" are destroying any hope you will ever have to make a living.

    I've been hearing that for decades as a construction worker, warehouse worker, spaghetti cook, virtual world tester, video game tester, help desk/desktop support technician, data center technician, PC refresh technician, and, currently, security remediation technician. None of my jobs were ever replaced by automation.

  18. Re:Best way to get a tech job by LifesABeach · · Score: 1

    I was wondering if machine learning couldn't be used against such things as Car Insurance, or any kind of Insurance?

  19. Re:Best way to get a tech job by DigiShaman · · Score: 1

    With loggers that connect to your OBD2 port, absolutely! Statistical analysis is what machine learning was built for! And that's really what insurance pricing is based off of; Statistics.

    --
    Life is not for the lazy.
  20. Study Machine Learning and get a well-paid job by erwincoumans · · Score: 1

    How much are a dozen deep-learning researchers worth? Apparently, more than $400 million to Google with their DeepMind purchase:
    http://www.technologyreview.co...

  21. Re:Best way to get a tech job by LifesABeach · · Score: 1

    I was thinking along the lines of, "value of money spent." Also, using ML to assist the client in navigating the procedures for claims handling. There is a mountain of actuarial data, and the user would know about themselves; why not have the ML apply that data against the various Insurance company's and evaluate? This would a hell of a business plan.

  22. Re:Useless by frank_adrian314159 · · Score: 3, Interesting

    No, but many of the jobs you might have had were automated out of existence. Meaning that the ratio of jobs to applicants is shrinking because automation now creates fewer jobs than they replace. Either way, you'll be out of work eventually.

    --
    That is all.