Friday, May 21, 2010

GPU and Speech Processing

We have been planning this for ages: utilizing GPU in nexiwave's speech processing. Now, we finally did it. Before the official release to our production decoding environment, our test environment shows dramatic speed improvement with GPU. A few things that are very worth noting:
  • do follow best practices from nividia:0
  • Critical best practices:
  • find those loops
  • memory coalesce
The first is quite obvious. The second is subtle. Anyway, our speed data as follows:

with GPU:
[java] Score 2134 0.0000s 0.0000s 0.0570s 0.0084s 17.9790s
[java] Grow 11238 0.0000s 0.0000s 0.1950s 0.0040s 45.2970s
[java] Scoring-Cuda 2124 0.0010s 0.0000s 0.0020s 0.0010s 2.1580s

without GPU (64 bit):
[java] Score 2134 0.0000s 0.0000s 0.4000s 0.0488s 104.1230s
[java] Grow 11238 0.0000s 0.0000s 0.1980s 0.0032s 36.0170s

without GPU (32 bit):
[java] Score 9607 0.0000s 0.0000s 0.2150s 0.0343s 329.9720s
[java] Prune 57599 0.0000s 0.0000s 0.0910s 0.0005s 30.7650s
[java] Grow 57642 0.0000s 0.0000s 0.7900s 0.0059s 339.4380s



Quite amazing, isn't it? Acoustic scoring time reduced from 104s -> 17s. Also, note the GPU only took 2s.

edit: If you must know how much was shipped to GPU: that's 15 million loops per 0.1s of audio

78 comments:

  1. hi, can you share your GPU-enabled code or any pointers on how to speed up cmu sphinx4 on GPUs? thanks!

    ReplyDelete
  2. it would only ask you what day you want to fly instead of making you repeat your entire itinerary.speech recognition software

    ReplyDelete
  3. This makes it conceivable to take in another dialect, or two, from the solace of one's own home for moderately minimal effort contrasted with costly dialect programming. text to speech api

    ReplyDelete
  4. This is quite educational arrange. It has famous breeding about what I rarity to vouch. Colossal proverb.
    This trumpet is a famous tone to nab to troths. Congratulations on a career well achieved. This arrange is synchronous s informative impolites festivity to pity. I appreciated what you ok extremely here 


    Selenium training in bangalore
    Selenium training in Chennai
    Selenium training in Bangalore
    Selenium training in Pune
    Selenium Online training

    ReplyDelete
  5. This comment has been removed by the author.

    ReplyDelete
  6. Thank you for excellent article.You made an article that is interesting.
    AWS Solutions Architect courses in Bangalore with certifications.
    https://onlineidealab.com/aws-training-in-bangalore/


    ReplyDelete
  7. Thank you for sharing such a nice post!

    Get SAP HANA Training in Bangalore from Real Time Industry Experts with 100% Placement Assistance in MNC Companies. Book your Free Demo with Softgen Infotech.

    ReplyDelete
  8. It is amazing and wonderful to visit your site.Thanks for sharing this information,this is useful . SAP ABAP Training in Bangalore

    ReplyDelete
  9. I have read your blog its very attractive and impressive. I like it your blog.sap fico training in bangalore

    ReplyDelete
  10. Great post!I am actually getting ready to across this information,i am very happy to this commands.Also great blog here with all of the valuable information you have.Well done,its a great knowledge.sap hana training in bangalore


    ReplyDelete
  11. Thanks for one marvelous posting! I enjoyed reading it; you are a great author. I will make sure to bookmark your blog and may come back someday. I want to encourage that you continue your great posts.sap hr training in bangalore

    ReplyDelete
  12. Thank you for your post. This is excellent information. It is amazing and wonderful to visit your site.sap sd training in bangalore

    ReplyDelete
  13. Awesome,Thank you so much for sharing such an awesome blog.sap mm training in bangalore

    ReplyDelete
  14. This comment has been removed by the author.

    ReplyDelete
  15. Its a wonderful post and very helpful, thanks for all this information. You are including better information regarding this topic in an effective way.

    https://docs.google.com/document/d/1Y21UswvqClCOnCqhGxx8vcNazbqpzL0bpiB4mH1IHUQ/edit?ts=5ec64aec

    ReplyDelete
  16. After reading your article I was amazed. I know that you explain it very well. And I hope that other readers will also experience how I feel after reading your article.
    Ethical Hacking Course in Bangalore
    Certified Ethical Hacker Course

    ReplyDelete
  17. You have posted a beautiful blog, keep sharing. good article I was really good article, it was very interesting and it is very useful for me
    IELTS Coaching in chennai

    German Classes in Chennai

    GRE Coaching Classes in Chennai

    TOEFL Coaching in Chennai

    spoken english classes in chennai | Communication training


    ReplyDelete
  18. Cool stuff you have and you keep overhaul every one of us.

    Data Science Course

    ReplyDelete
  19. Thanks for the informative and helpful post, obviously in your blog everything is good..

    Data Science Training

    ReplyDelete
  20. Nice post found to be very impressive while going through this post which i come across too late. Thanks for sharing and keep posting such an informative content.

    360DigiTMG Cyber Security Course

    ReplyDelete
  21. Thanks for the lovely blog. It helped me a lot. I'm glad I found this blog. Thanks for sharing with us, I too am always learning something new from your post.

    360DigiTMG Data Science Courses

    ReplyDelete
  22. Thanks for sharing great information. I highly recommend you.data science courses

    ReplyDelete
  23. I would like to see video how you do it. Will you post one for me? I can buy youtube likes from this site https://soclikes.com/ for you. What do you say?

    ReplyDelete
  24. Python programming training ensures that students are able to use this highly potential programming language to the best of its capabilities in an exciting and fun way. data science course in india

    ReplyDelete
  25. New site is solid. A debt of gratitude is in order for the colossal exertion.
    Data Science Training in Hyderabad


    ReplyDelete
  26. Great information. The above content is very interesting to read. This will be loved by all age groups.
    fibonacci series
    multilevel inheritance in python

    ReplyDelete
  27. I see some amazingly important and kept up to a length of your strength searching for in your on the site

    Best Data Science courses in Hyderabad

    ReplyDelete
  28. I am sure that this is going to help a lot of individuals. Keep up the good work. It is highly convincing and I enjoyed going through the entire blog.

    business analytics course

    ReplyDelete
  29. With special privileges and services, UEFA BET offers opportunities for small capitalists. Together ufa with the best websites that collect the most games With a minimum deposit starting from just 100 baht, you are ready to enjoy the fun with a complete range of betting that is available within the website

    ufabet , our one another option We are a direct website, not through an agent, where customers can have great confidence without deception The best of online betting sites is that our Ufa will give you the best price

    หาคุณกำลังหาเกมส์ออนไลน์ที่สามารถสร้างรายได้ให้กับคุณ เรามีเกมส์แนะนำ เกมยิงปลา รูปแบบใหม่เล่นง่ายบนมือถือ คาสิโนออนไลน์ บนคอม เล่นได้ทุกอุปกรณ์รองรับทุกเครื่องมือ มีให้เลือกเล่นหลายเกมส์ เล่นได้ทั่วโลกเพราะนี้คือเกมส์ออนไลน์แบบใหม่ เกมยิงปลา

    อีกทั้งเรายังให้บริการ เกมสล็อต ยิงปลา แทงบอลออนไลน์ รองรับทุกการใช้งานในอุปกรณ์ต่าง ๆ HTML5 คอมพิวเตอร์ แท็บเล็ต สมาทโฟน คาสิโนออนไลน์ และมือถือทุกรุ่น เล่นได้ตลอด 24ชม. ไม่ต้อง Downloads เกมส์ให้ยุ่งยาก ด้วยระบบที่เสถียรที่สุดในประเทศไทย

    ReplyDelete
  30. This is an awesome motivating article. I am practically satisfied with your great work. You put truly extremely supportive data. Keep it up. Continue blogging. Hoping to pursue your next post

    Best Data Science courses in Hyderabad

    ReplyDelete
  31. Probably the most genuine football betting UFABET that's beyond description Find fun, excitement and excitement with slot video games, hundred totally free recognition, quick withdrawal. If you desire to have fun slots for money No need to deposit a great deal, no minimum, no need to share, squander moment for the reason that UFABET is in fact reduced, given seriously, many great offers are waiting for you. Prepared to ensure pleasurable, regardless of whether it's Joker SlotXo fruit slot, we are able to phone it an internet slot website for you personally especially. Ready to have fun Like the support staff which is going to facilitate slot formulas as well as techniques of actively playing So you will be certain that each minute of fun and pleasure We will be there for one to give your customers the best appearance as well as fulfillment.
    บาคาร่า
    สล็อต
    ufa
    แทงบอล

    ReplyDelete
  32. Interesting post. I Have Been wondering about this issue, so thanks for posting. Pretty cool post.It 's really very nice and Useful post.Thanks
    digital marketing courses in hyderabad with placement

    ReplyDelete
  33. Very awesome!!! When I seek for this, I found this website at the top of all blogs in search engine.
    AWS Training in Hyderabad
    AWS Course in Hyderabad

    ReplyDelete
  34. A great website with interesting and unique material what else would you need.
    data scientist certification malaysia

    ReplyDelete
  35. I like reading through a post that will make people think. Also, thank you for permitting me to comment.
    servicenow training in Bangalore

    ReplyDelete
  36. Extremely overall quite fascinating post. I was searching for this sort of data and delighted in perusing this one. Continue posting
    Mulesoft training in hyderabad

    ReplyDelete
  37. Its content is brilliant in many ways. I think it is an attractive and revealing material. Thank you very much for caring about your content and your readers.

    Cloud Computing Institutes in Bangalore

    ReplyDelete
  38. i am glad to discover this page : i have to thank you for the time i spent on this especially great reading !! i really liked each part and also bookmarked you for new information on your site.
    cyber security course in patna

    ReplyDelete
  39. It's like you've got the point right, but forgot to include your readers. Maybe you should think about it from different angles.

    Data Scientist Course in Nashik

    ReplyDelete
  40. I wanted to leave a little comment to support you and wish you the best of luck. We wish you the best of luck in all of your blogging endeavors.

    Data Analytics Course in Patna

    ReplyDelete
  41. iTop VPN Crack will allow you to securely obtain the global Internet and even surf anonymously - an exceptionally well-known VPN course utilized by hundreds of thousands of Internet clientele to hide their id as well as surf anonymously.

    ReplyDelete
  42. 360DigiTMG, the top-rated organisation among the most prestigious industries around the world, is an educational destination for those looking to pursue their dreams around the globe. The company is changing careers of many people through constant improvement, 360DigiTMG provides an outstanding learning experience and distinguishes itself from the pack. 360DigiTMG is a prominent global presence by offering world-class training. Its main office is in India and subsidiaries across Malaysia, USA, East Asia, Australia, Uk, Netherlands, and the Middle East.

    ReplyDelete

  43. When you have understood the basic concepts of data science, you must choose a path to move in data science. You need to learn the following courses to be an expert in the field of data science.
    data science course in gorakhpur

    ReplyDelete
  44. It is different from the data insight aspect. Algorithms are used to develop data, whereas the executives make better decisions about the product using data insight.
    data science course in lucknow

    ReplyDelete
  45. This very informative and interesting blog. I have read many blog in days but your writing style is very unique and understanding. if you are interested in home appliances then click below.buy home appliances

    ReplyDelete
  46. You have such a wonderful ability to make people feel valued and appreciated. Buy google suite pricing from google suite pricing

    ReplyDelete
  47. Thank you for providing this information. Visit us to get Online Tuition for Class 8 at Affordable prices.

    ReplyDelete