Slashdot Mirror


Student Makes 'Shazam For Fonts', a Gadget That Detects Fonts and Captures Colors (theverge.com)

Imagine being able to use a miniature device which could quickly tell you the kind of font you're looking at in a book, and also tell you about its color. Fiona O'Leary, a student at the Royal College of Art, has developed exactly that kind of device, and she is calling it Spector. The device, which is in its prototype phase, also saves the font type information and loads the data on Adobe InDesign. The Verge reports: If she loved the font London uses on its subway maps, for instance, she could use this device to capture that font and load it into Adobe InDesign. Spector takes a photo of the font and uses an algorithm to translate that image into information about the shape of letters and symbols. It then cross-references that information with a font database to correctly identify it. The Spector also captures colors and breaks them down into CMYK/RGB values.

71 comments

  1. Uh yeah... that already exists by Anonymous Coward · · Score: 0

    What's next a student who invents a Shazam for music?

    1. Re:Uh yeah... that already exists by Anonymous Coward · · Score: 0

      If it already exists, why not tell us the name? Or give us a link to it?

    2. Re: Uh yeah... that already exists by Anonymous Coward · · Score: 1

      WhatTheFont.com

    3. Re: Uh yeah... that already exists by Anonymous Coward · · Score: 0

      I bet the device in the pictures is a mockup and the software smoke and mirrors. This is just running because a woman did it. If the person who made this has a working version it probably relies heavily on third party APIs.

    4. Re: Uh yeah... that already exists by Anonymous Coward · · Score: 4, Informative
    5. Re: Uh yeah... that already exists by Anonymous Coward · · Score: 0

      redirect link

    6. Re:Uh yeah... that already exists by Anubis+IV · · Score: 1

      Indeed. I've been using WhatTheFont for identifying fonts from pictures since it was launched in 2011. And being able to pull a color from an image is nothing new either. Everything from the built in Digital Color Meter app on every Mac to the Sherwin Williams paint app on my tablet can pull colors from images.

    7. Re: Uh yeah... that already exists by Anonymous Coward · · Score: 0

      Here is the actual link:

      WhatTheFont

    8. Re:Uh yeah... that already exists by amicusNYCL · · Score: 1

      the Sherwin Williams paint app on my tablet can pull colors from images

      There's an app that replicates the "eye dropper" tool that's available in any image editing application? Does it cost money?

      --
      "Our two-party system is like a bowl of shit looking at itself in a mirror." - Lewis Black
    9. Re:Uh yeah... that already exists by ceoyoyo · · Score: 3, Interesting

      It shouldn't. It's pretty trivial. You could do it yourself by taking a picture then using that eyedropper tool on it.

      You might not get the results you expect though. The color the camera sees will depend a lot on the illumination color. And your eyes don't faithfully report the actual color of things.

    10. Re: Uh yeah... that already exists by ragahast · · Score: 1

      For something like 6 years, too.

      --
      .:Semper Absurda:.
    11. Re:Uh yeah... that already exists by Joce640k · · Score: 1

      Imagine being able to use a miniature device which could quickly tell you the kind of font you're looking at in a book

      OK, let's imagine....

      (bursts out laughing)

      Nope. Not seeing any use for this at all. If you spend all day worrying about the fonts you see in the world then get a life.

      --
      No sig today...
    12. Re:Uh yeah... that already exists by Anonymous Coward · · Score: 1

      Eyes? Colours? No. Everything.

      Our entire sense of vision is an illusion our brain creates as an interpretation of the real world.

      The brain relies on information fed to it to determine what is happening in the world. It has no direct connection of its own and must rely on information sent through nerves to tell what is going on.

      Humans can not truly see, hear, smell or feel the world. At best a human can derive a point of reference for a moment in time limited to the sensitivity of the organs available.

      That we can experience colours at all is amazing and taken for granted. But. The colours you see and the colours I see are different. Unless you are my clone. In which case I complement you on your length and girth.

      Many men are colourblind.

      Mobile phones are not too far off. Colours change with darkness angles and can be difficult to specify.

      I for one welcome our new optical overlords when they will be available for the sensitive colour connoisseur in the supermarket specials bin.

    13. Re:Uh yeah... that already exists by lucm · · Score: 1

      Our entire sense of vision is an illusion our brain creates as an interpretation of the real world.

      Morpheus, is that you?

      --
      lucm, indeed.
    14. Re: Uh yeah... that already exists by lucm · · Score: 1

      Or maybe she's a genius and this device is detecting the font, then uses an advanced algorithm that sends vibrations across the book to make it type the font name. That's why she keeps putting books on her macbook keyboard in the video.

      --
      lucm, indeed.
    15. Re:Uh yeah... that already exists by Anonymous Coward · · Score: 1

      > You might not get the results you expect though.

      ESPECIALLY, if the font is MF'ing COMIC SANS!

    16. Re:Uh yeah... that already exists by ceoyoyo · · Score: 1

      I'm bored. Can I have some of what you're smoking?

  2. Oh shit... by Event+Horizon · · Score: 1

    An "algorithm"!

    --
    You don't need a weatherman to know which way the wind blows. - Bob Dylan "Subteranean Homesick Blue
    1. Re:Oh shit... by Tablizer · · Score: 1

      in MongoDeepNode.js+++ with appier apping of apps!

  3. Already exists by mark-t · · Score: 2, Informative

    WhatTheFont can look at font text and tell you what it is.

    Taking an existing color and converting it to RGB or CMYK is what any hardware store that will color-match paint to a sample has been doing for years.

    1. Re: Already exists by Anonymous Coward · · Score: 0

      Do you know of any service that can also recommend the closest-looking free font?

    2. Re: Already exists by mark-t · · Score: 1

      From what I recall, WhatTheFont! usually gives multiple matches for any sample image, because many fonts are very similar. It shows you samples in each font it finds as well, so you can visually compare with the original. Often there will be a free font among those shown.

    3. Re:Already exists by Anonymous Coward · · Score: 1, Informative

      But did a woman make it?

      No? See. This one is better!

    4. Re:Already exists by karniv0re · · Score: 2

      Lots of things are just improvements on other things.

      But by making this a device, it actually seems to be a degradation. Now we have to carry another device around? What's wrong with making this a mobile app? It would literally do the exact same thing.

    5. Re:Already exists by Anonymous Coward · · Score: 1

      Yeah, but this one was designed by a WOMAN

    6. Re:Already exists by Anonymous Coward · · Score: 0

      Not only that, an app would do it better, not being limited to her ability to add detection for more than seven fonts. By leveraging whatthefont she could have trivially written an app that could detect *many* fonts, not just seven.

      But then it wouldn't be that cool. I mean, I get that it is geeky to make a device and to code the detection of features. Writing an app that calls an API is pretty pedestrian. But it is a lot more practical.

    7. Re:Already exists by Pahroza · · Score: 2

      I don't know, I bet this thing has less space than a Nomad. Lame.

    8. Re:Already exists by arth1 · · Score: 1

      WhatTheFont can look at font text and tell you what it is.

      Every time I've tried it, it has misidentified. And it's not like the differences were tiny either - it's oblivious to things like whether the point of a V is flat or pointy, or whether 3/4/5/7/9 are descending below the base line.

      If someone could launch a font identification tool that actually works, it would be swell. My guess is that too many commercial fonts have unreasonable licenses that prevent them from being used, but I could be wrong.

    9. Re:Already exists by wonkey_monkey · · Score: 1

      Lots of things are just improvements on other things.

      Why, the fax machine is nothing but a waffle iron with a phone attached!

      --
      systemd is Roko's Basilisk.
    10. Re: Already exists by dinfinity · · Score: 1

      From TFA: "The prototype recognizes seven different font families [...]"

      Yeah, that's much better than WhatTheFont.

    11. Re:Already exists by Anonymous Coward · · Score: 0

      No doubt the software will be afapted for android and iphone soon enough

  4. I don't see how. by Anonymous Coward · · Score: 0

    The Spector also captures colors and breaks them down into CMYK/RGB values.

    This doesn't seem possible to do accurately through a cellphone camera without some other lighting and/or color reference being present. Lighting color temperature is an obvious place that this could be thrown off, as well as other difficult-to-control variables such as light intensity, shadows, sheen, and numerous other factors that could skew the colors as recorded on a digital camera.

    To say nothing of any processing the camera itself does upstream of passing the image off to the app (for example, an auto-white-balance or color correction).

    Capturing color reliably is a challenge under controlled conditions. Off a cell phone camera? I wouldn't bank on it.

    1. Re:I don't see how. by Anonymous Coward · · Score: 0

      the quoted claim doesn't mention say anything about the color being accurate, just that values are provided. That is easy: just analyze the text fill and average out the values. As the sensor is almost certainly providing an RGB jpg this will be an RGB value which can be trivially converted to a CMYK value. Will the RGB and CMYK values produce the same color? No. Will either match the original font's color? No. Will it be weighted in the correct direction? Most likely.

      The "cool" part of the story is that the individual has written (or re-used) code do OCR and feature identification. It can't really identify a font and the idea doesn't scale particularly well -- especially for a (presumably) off-line device. It can only suggest font whose features are recorded in the database. The claim is seven fonts. Wow, that's ... a start?

      Something that would be practical (and much easier to do) would be to write an app that streamlined the process of taking the picture and uploading it to WhatTheFont. It could probably get a slashvertisement and be available on iOS and Android within a day.

    2. Re:I don't see how. by flargleblarg · · Score: 2

      This doesn't seem possible to do accurately through a cellphone camera without some other lighting and/or color reference being present.

      You mean, like, oh, maybe a built-in flash that exists on every smartphone camera?

    3. Re:I don't see how. by Anonymous Coward · · Score: 0

      The claim is seven fonts. Wow, that's ... a start?

      If it can correctly identify Papyrus and Helvetica, then the job is halfway done.

  5. wow, nobody's thought of that before... by Anonymous Coward · · Score: 1

    Are the Fontspring matcherator and the Fontsquirrel matherator the same thing?

    Whatfontis ?
    Identitfyfont?

    Here's a list of seven more microaggressions.

  6. Ok... by Anonymous Coward · · Score: 2, Insightful

    So she uploads a photo to WhatTheFont using the api they provide for doing just that, and then pulls the RGB values from the not-in-anyway-colour-calibrated image and converts them to CMYK.

    Fucking groundbreaking.

    1. Re:Ok... by Anonymous Coward · · Score: 0

      "Not in any way", two words.

    2. Re:Ok... by Anonymous Coward · · Score: 0

      Well, that would be my thought, but if you break the rules and read the article (okay, I only skimmed it) her device only has knowledge of 7 fonts so it does sound like she is actually doing feature recognition for all of seven fonts. Who knows with what accuracy (false positives? false negatives?), but allegedly she wrote or re-used code to do that and has built (or had built) a prototype device.

      Kinda neat, if she wrote the code herself. More practical would be to write an app that uses whatthefont. Not that you need an app, but done right it could simplify the process.

      Oh, her solution does one other thing: it loads the font information into Adobe InDesign, whatever that means. Yay.

    3. Re:Ok... by tomhath · · Score: 1

      her solution does one other thing

      It also requires that funky looking camera that won't fit in a pocket. But the shroud might mean it has its own light source so color accuracy could be okay.

    4. Re:Ok... by Anonymous Coward · · Score: 0

      The target appears to be illuminated through the clear plastic, so unless there's a spectrometer in there somewhere (or a bunch of color targets to calibrate it) the accuracy isn't going to be any better than the camera on your phone. Compare with something like the Pantone color clickers, where you have a small plastic window to find the right spot, which you then cover with your thumb and press to take a sample. They have an assortment of LED's to illuminate the target with monochromatic-ish light.

      As someone else said, the whole think reeks of mock-up. Decent camera + optics + micro controller + some sort of wifi / bluetooth radio + battery + a nice big ergonomic button on the top in something the size of half a golf ball, and that's assuming it offloads all the image processing elsewhere. If they've done the necessary engineering to actually build the thing, they'll have spent long enough with it to realize it's useless.

  7. This is news worthy? by Anonymous Coward · · Score: 0

    What has the world come to.

  8. Fiona O'Leary ... by cwarrior · · Score: 1

    Just in case you were wondering: Fiona means "white" and "O'Leary" means "keeper of the calves." Carry on.

    1. Re:Fiona O'Leary ... by Anonymous Coward · · Score: 0

      Phew, for a second I was starting to lose my sense of righteous indignation and actually become genuinely curious about a headline on slashdot.

    2. Re:Fiona O'Leary ... by Anonymous Coward · · Score: 2, Funny

      Fiona means "white" and "O'Leary" means "keeper of the calves."

      Fiona means parents care enough about being respectable in Ireland to give her an Irish name, but are not secure enough to give here the more upper class (and abroad unpronounceable) "Saoirse". "O'Leary" means that the family have not yet married into a high enough status clan to afford a double barrelled, post independence gaelcised name like "McDonagh-Ã" FaolÃin".

      This necessitated sending the child abroad for better qualifications, though clearly enough money and influence has been gained in the meantime to afford a promotional media story, which points to a guilded future on return to Dublin, likely running a studio with several lucrative multi-million euro projects designing fonts and logos for Government Quangos and occasionally appearing at race meetings.

      IMHO

  9. form before function, gonna get punctured... by Thud457 · · Score: 1

    Google actually has a tool to do just that.

    --

    the preceding comment is my own and in no way reflects the opinion of the Joint Chiefs of Staff

  10. Kiss my Wingding! by Tablizer · · Score: 1

    I'm itchin' to try it on the ol' Wingding font

  11. what? by Anonymous Coward · · Score: 0

    It can identify 7 font families and....

    So like the tabs on the fonts website that has 1000 entries under each family?
    Pretty sure even I can guess the family. Does the other info actually help you pick one of those 1000 choices?

  12. Uhh, copyright? by magarity · · Score: 1

    Some people (big companies) get all bent out of shape if you rip off their font without a license to do so.

    1. Re:Uhh, copyright? by Pfhorrest · · Score: 2

      If the company is using a custom font for their logotype, it's not going to be in the database this uses (and even if it was, you're not going to be able to find the font unless the company provides it to you, or someone leaked it, in which case using it is already copyright violation, but knowing its name isn't).

      If the company is using a publicly available font for their logotype, they have no grounds for complaint if someone else uses the same font. I can't start "Pfhorrest Comics" with a logotype of just those words in Comic Sans and then sue you for making your "Magarity Comics" logo also use Comic Sans.

      --
      -Forrest Cameranesi, Geek of all Trades
      "I am Sam. Sam I am. I do not like trolls, flames, or spam."
    2. Re:Uhh, copyright? by techno-vampire · · Score: 1

      That was my thought at first. However, if you RTFS (I know, I know, this is Slashdot, where people post first and RTFS later if at all.) you'll find that all it does is identify the font if it can. If you want to use the font, you still have to get a copy of it, and if it's a custom font, you probably won't be able to find it.

      --
      Good, inexpensive web hosting
    3. Re:Uhh, copyright? by Anonymous Coward · · Score: 0

      The actual look of a font is not copyrighted; only the font file is. You can scan glyphs and create your own font file from the graphical representation. That's why there are so many fonts that look almost exactly like famous fonts. If you plan on doing this on a commercial scale, ask a lawyer first. Don't mistake an AC's opinion for legal advice.

  13. I've got a feeling... by Dust038 · · Score: 1

    ...that not too long from now if this does go into mass production that the Government and CSI Organizations will use this technology to match handwriting samples at the touch of a button. Note: My comment my be misplaced as I do not keep up with CSI Field Technologies.

    1. Re:I've got a feeling... by Anonymous Coward · · Score: 0

      Terrifying and probably highly accurate

      The Ministry of Truth summons YOU

  14. 1998 again? by Anonymous Coward · · Score: 0

    For a minute I thought it was 1998 all over again. Maybe this student wasn't born when the idea was first crrated (and hasn't heard of Google)

  15. A cool idea that is incredibly poorly executed by flargleblarg · · Score: 1

    Seriously? A dedicated device for this? In 2016? It should just be a smartphone app. No need for separate hardware.

    Lame.

    1. Re:A cool idea that is incredibly poorly executed by Anonymous Coward · · Score: 0

      My thoughts exactly.

  16. Adobe MAX Sneaks 2015 by Anonymous Coward · · Score: 0

    Somebody attended Adobe MAX last year and watched the Sneaks...
    https://youtu.be/5eJ3IXYcw3M

    Adobe is already working on adding this functionality to Photoshop and integrating with TypeKit. Of course that would also include color selection (to a MUCH greater extent) and integration with every other Adobe app, including InDesign.

  17. Typefaces can be design patented by tepples · · Score: 1

    Many countries offer design registration that confers exclusive rights in a typeface for a term between 14 years (United States) and 25 years (Great Britain). But you're correct that after this expires, it becomes legal to launder the typeface a font with the print-scan-trace method, so long as you A. don't refer to the original font's control points in your trace and B. don't use a similar name for your font. Instead derive the control points from the rules set forth in the "Digitizing" chapter of Apple's TrueType Reference Manual : one on-curve point on every corner, vertical or horizontal tangent, point of inflection, or large change in curvature, and at least one intermediate point every 45 degrees. Then the off-curve point between each pair of on-curve points goes at the intersection of the lines tangent to those points.

  18. Color Grab by BitterKraut · · Score: 1

    There are several smartphone apps, Color Grab being one of them, that let you identify colors at any distance, no extra hardware required. Btw. I suspect the video to be faked. It would require very advanced AI to recognize any font instantly. Usually you have to guide the software by identifying some of the characters before a match is trying to be found.

    1. Re:Color Grab by ceoyoyo · · Score: 1

      Not advanced at all. I just taught a workshop on neural networks using identifying both the location and value of several handwritten digits scattered randomly in a larger image as an example problem.

      Fonts are easier because they're much more consistent than handwritten characters.

  19. All that's old is new again by Anonymous Coward · · Score: 0

    Seriously? CorelDRAW has been able to vectorize images and make fonts out of them since the 1980's. Maybe this is "amazing" because it's a phone app... OMG PONIES!

  20. unless you can properly white balance by Anonymous Coward · · Score: 1

    or you have a refence colour in shot, your RGB values are completely fucking meaningless

    1. Re:unless you can properly white balance by BitterKraut · · Score: 1

      Tell this to a color blind person.

    2. Re:unless you can properly white balance by Anonymous Coward · · Score: 0

      unless you can properly white balance or you have a refence colour in shot, your B values are completely fucking meaningless

    3. Re:unless you can properly white balance by BitterKraut · · Score: 1

      So color blind people can draw information from what's meaningless to others? Or does completely f**king meaningless mean potentially biased?

  21. Not convinced by BitterKraut · · Score: 1

    Where is the OCR software that first identifies the font, then reconstructs the text until it's pixel perfect? I recently evaluated a selection of current OCR software and was most disappointed to see how little progress has been made in the last decade.

    1. Re:Not convinced by jabuzz · · Score: 1

      Interesting thought. One would imagine that identifying the font first should radically improve the accuracy of the OCR on all those difficult bits like 1/l etc.

  22. Can it detect the SpaceX font? by RogueWarrior65 · · Score: 1

    But can this gadget accurately determine what font SpaceX uses for it's on-screen telemetry display? I've tried this several times using several online recognizers and none of them get it right.

  23. describe-it app by yes-but-no · · Score: 1

    This must be made a specific instance of a general object recognition. With AI and image recognition seen great progress in the last 4 or 5 years, sending a picture to the backend should give all details of it. [eg send a pic of a flower, it should tell me what it is]

  24. Free version by T.E.D. · · Score: 1

    Sadly, unless you spring for the premium version, it will say every font is Comic Sans.