Friday, May 21, 2010

GPU and Speech Processing

We have been planning this for ages: utilizing GPU in nexiwave's speech processing. Now, we finally did it. Before the official release to our production decoding environment, our test environment shows dramatic speed improvement with GPU. A few things that are very worth noting:
  • do follow best practices from nividia:0
  • Critical best practices:
  • find those loops
  • memory coalesce
The first is quite obvious. The second is subtle. Anyway, our speed data as follows:

with GPU:
[java] Score 2134 0.0000s 0.0000s 0.0570s 0.0084s 17.9790s
[java] Grow 11238 0.0000s 0.0000s 0.1950s 0.0040s 45.2970s
[java] Scoring-Cuda 2124 0.0010s 0.0000s 0.0020s 0.0010s 2.1580s

without GPU (64 bit):
[java] Score 2134 0.0000s 0.0000s 0.4000s 0.0488s 104.1230s
[java] Grow 11238 0.0000s 0.0000s 0.1980s 0.0032s 36.0170s

without GPU (32 bit):
[java] Score 9607 0.0000s 0.0000s 0.2150s 0.0343s 329.9720s
[java] Prune 57599 0.0000s 0.0000s 0.0910s 0.0005s 30.7650s
[java] Grow 57642 0.0000s 0.0000s 0.7900s 0.0059s 339.4380s



Quite amazing, isn't it? Acoustic scoring time reduced from 104s -> 17s. Also, note the GPU only took 2s.

edit: If you must know how much was shipped to GPU: that's 15 million loops per 0.1s of audio

51 comments:

  1. hi, can you share your GPU-enabled code or any pointers on how to speed up cmu sphinx4 on GPUs? thanks!

    ReplyDelete
  2. it would only ask you what day you want to fly instead of making you repeat your entire itinerary.speech recognition software

    ReplyDelete
  3. This makes it conceivable to take in another dialect, or two, from the solace of one's own home for moderately minimal effort contrasted with costly dialect programming. text to speech api

    ReplyDelete
  4. Hi, Great.. Tutorial is just awesome..It is really helpful for a newbie like me.
    I am a regular follower of your blog. Really very informative post you shared here. Kindly keep blogging.
    If anyone wants to become a Java developer learn from Java EE Online Training from India.
    or learn thru Java EE Online Training from India .
    Nowadays Java has tons of job opportunities on various vertical industry.

    ReplyDelete
  5. This is quite educational arrange. It has famous breeding about what I rarity to vouch. Colossal proverb.
    This trumpet is a famous tone to nab to troths. Congratulations on a career well achieved. This arrange is synchronous s informative impolites festivity to pity. I appreciated what you ok extremely here 


    Selenium training in bangalore
    Selenium training in Chennai
    Selenium training in Bangalore
    Selenium training in Pune
    Selenium Online training

    ReplyDelete
  6. Great post and informative blog.it was awesome to read, thanks for sharing this great content to my vision.
    Good discussion.
    Java Training in Chennai
    Java Training in Coimbatore
    Java Training in Bangalore

    ReplyDelete
  7. This comment has been removed by the author.

    ReplyDelete
  8. thanks for your information really good and very nice web design company in velachery

    ReplyDelete
  9. Aluminium Composite Panel or ACP Sheet is used for building exteriors, interior applications, and signage. They are durable, easy to maintain & cost-effective with different colour variants.

    ReplyDelete
  10. Thank you for excellent article.You made an article that is interesting.
    AWS Solutions Architect courses in Bangalore with certifications.
    https://onlineidealab.com/aws-training-in-bangalore/


    ReplyDelete
  11. Great blog thanks for sharing Your website is the portal to your brand identity. The look and feel of every page carry a strong message. This is why your brand needs the best web design company in chennai to capture your visions and make it art. Adhuntt Media is graced with the most creative design team in Chennai.
    digital marketing company in chennai

    ReplyDelete
  12. Nice blog thanks for sharing Evolve past boring simple rooftops and bling them up by converting your upstairs to a terrace garden. Interested? Get your very own at Karuna Nursery Gardens - the best terrace garden service in Chennai.
    plant nursery in chennai

    ReplyDelete
  13. Excellent blog thanks for sharing It’s time you upgraded your Salon to meet global standards. Do that with the best wholesale cosmetic market in Chennai - The Pixies Beauty Shop.
    Cosmetics Shop in Chennai

    ReplyDelete
  14. Thank you for sharing such a nice post!

    Get SAP HANA Training in Bangalore from Real Time Industry Experts with 100% Placement Assistance in MNC Companies. Book your Free Demo with Softgen Infotech.

    ReplyDelete
  15. It is amazing and wonderful to visit your site.Thanks for sharing this information,this is useful . SAP ABAP Training in Bangalore

    ReplyDelete
  16. I have read your blog its very attractive and impressive. I like it your blog.sap fico training in bangalore

    ReplyDelete
  17. Great post!I am actually getting ready to across this information,i am very happy to this commands.Also great blog here with all of the valuable information you have.Well done,its a great knowledge.sap hana training in bangalore


    ReplyDelete
  18. Thanks for one marvelous posting! I enjoyed reading it; you are a great author. I will make sure to bookmark your blog and may come back someday. I want to encourage that you continue your great posts.sap hr training in bangalore

    ReplyDelete
  19. Thank you for your post. This is excellent information. It is amazing and wonderful to visit your site.sap sd training in bangalore

    ReplyDelete
  20. Awesome,Thank you so much for sharing such an awesome blog.sap mm training in bangalore

    ReplyDelete
  21. Thanks for sharing this blog. This very important and informative blog.SAP SRM Training in Bangalore

    ReplyDelete
  22. Learned a lot of new things from your post! Good creation and HATS OFF to the creativity of your mind.sap wm training in bangalore

    ReplyDelete
  23. Thanks for one marvelous posting! I enjoyed reading it; you are a great author. I will make sure to bookmark your blog and may come back someday. I want to encourage that you continue your great posts.Informatica Training in Bangalore

    ReplyDelete
  24. Thank you for your post. This is excellent information. It is amazing and wonderful to visit your site.MSBI Training in Bangalore

    ReplyDelete
  25. Awesome,Thank you so much for sharing such an awesome blog.Big Data Training in Marathahalli


    ReplyDelete
  26. Thanks for sharing this blog. This very important and informative blog.Tableau Training in Bangalore

    ReplyDelete
  27. Learned a lot of new things from your post! Good creation and HATS OFF to the creativity of your mind.Hadoop Training in Bangalore

    ReplyDelete