Friday, May 21, 2010

GPU and Speech Processing

We have been planning this for ages: utilizing GPU in nexiwave's speech processing. Now, we finally did it. Before the official release to our production decoding environment, our test environment shows dramatic speed improvement with GPU. A few things that are very worth noting:
  • do follow best practices from nividia:0
  • Critical best practices:
  • find those loops
  • memory coalesce
The first is quite obvious. The second is subtle. Anyway, our speed data as follows:

with GPU:
[java] Score 2134 0.0000s 0.0000s 0.0570s 0.0084s 17.9790s
[java] Grow 11238 0.0000s 0.0000s 0.1950s 0.0040s 45.2970s
[java] Scoring-Cuda 2124 0.0010s 0.0000s 0.0020s 0.0010s 2.1580s

without GPU (64 bit):
[java] Score 2134 0.0000s 0.0000s 0.4000s 0.0488s 104.1230s
[java] Grow 11238 0.0000s 0.0000s 0.1980s 0.0032s 36.0170s

without GPU (32 bit):
[java] Score 9607 0.0000s 0.0000s 0.2150s 0.0343s 329.9720s
[java] Prune 57599 0.0000s 0.0000s 0.0910s 0.0005s 30.7650s
[java] Grow 57642 0.0000s 0.0000s 0.7900s 0.0059s 339.4380s



Quite amazing, isn't it? Acoustic scoring time reduced from 104s -> 17s. Also, note the GPU only took 2s.

edit: If you must know how much was shipped to GPU: that's 15 million loops per 0.1s of audio

109 comments:

  1. hi, can you share your GPU-enabled code or any pointers on how to speed up cmu sphinx4 on GPUs? thanks!

    ReplyDelete
  2. it would only ask you what day you want to fly instead of making you repeat your entire itinerary.speech recognition software

    ReplyDelete
  3. This makes it conceivable to take in another dialect, or two, from the solace of one's own home for moderately minimal effort contrasted with costly dialect programming. text to speech api

    ReplyDelete
  4. Hi, Great.. Tutorial is just awesome..It is really helpful for a newbie like me.
    I am a regular follower of your blog. Really very informative post you shared here. Kindly keep blogging.
    If anyone wants to become a Java developer learn from Java EE Online Training from India.
    or learn thru Java EE Online Training from India .
    Nowadays Java has tons of job opportunities on various vertical industry.

    ReplyDelete
  5. This is quite educational arrange. It has famous breeding about what I rarity to vouch. Colossal proverb.
    This trumpet is a famous tone to nab to troths. Congratulations on a career well achieved. This arrange is synchronous s informative impolites festivity to pity. I appreciated what you ok extremely here 


    Selenium training in bangalore
    Selenium training in Chennai
    Selenium training in Bangalore
    Selenium training in Pune
    Selenium Online training

    ReplyDelete
  6. This comment has been removed by the author.

    ReplyDelete
  7. Thank you for excellent article.You made an article that is interesting.
    AWS Solutions Architect courses in Bangalore with certifications.
    https://onlineidealab.com/aws-training-in-bangalore/


    ReplyDelete
  8. Thank you for sharing such a nice post!

    Get SAP HANA Training in Bangalore from Real Time Industry Experts with 100% Placement Assistance in MNC Companies. Book your Free Demo with Softgen Infotech.

    ReplyDelete
  9. It is amazing and wonderful to visit your site.Thanks for sharing this information,this is useful . SAP ABAP Training in Bangalore

    ReplyDelete
  10. I have read your blog its very attractive and impressive. I like it your blog.sap fico training in bangalore

    ReplyDelete
  11. Great post!I am actually getting ready to across this information,i am very happy to this commands.Also great blog here with all of the valuable information you have.Well done,its a great knowledge.sap hana training in bangalore


    ReplyDelete
  12. Thanks for one marvelous posting! I enjoyed reading it; you are a great author. I will make sure to bookmark your blog and may come back someday. I want to encourage that you continue your great posts.sap hr training in bangalore

    ReplyDelete
  13. Thank you for your post. This is excellent information. It is amazing and wonderful to visit your site.sap sd training in bangalore

    ReplyDelete
  14. Awesome,Thank you so much for sharing such an awesome blog.sap mm training in bangalore

    ReplyDelete
  15. This comment has been removed by the author.

    ReplyDelete
  16. Its a wonderful post and very helpful, thanks for all this information. You are including better information regarding this topic in an effective way.

    https://docs.google.com/document/d/1Y21UswvqClCOnCqhGxx8vcNazbqpzL0bpiB4mH1IHUQ/edit?ts=5ec64aec

    ReplyDelete
  17. After reading your article I was amazed. I know that you explain it very well. And I hope that other readers will also experience how I feel after reading your article.
    Ethical Hacking Course in Bangalore
    Certified Ethical Hacker Course

    ReplyDelete
  18. You have posted a beautiful blog, keep sharing. good article I was really good article, it was very interesting and it is very useful for me
    IELTS Coaching in chennai

    German Classes in Chennai

    GRE Coaching Classes in Chennai

    TOEFL Coaching in Chennai

    spoken english classes in chennai | Communication training


    ReplyDelete
  19. I am impressed by the information that you have on this blog. Thanks for Sharing
    Ethical Hacking in Bangalore

    ReplyDelete
  20. Cool stuff you have and you keep overhaul every one of us.

    Data Science Course

    ReplyDelete
  21. Thanks for the informative and helpful post, obviously in your blog everything is good..

    Data Science Training

    ReplyDelete
  22. Nice post found to be very impressive while going through this post which i come across too late. Thanks for sharing and keep posting such an informative content.

    360DigiTMG Cyber Security Course

    ReplyDelete
  23. Thanks for the lovely blog. It helped me a lot. I'm glad I found this blog. Thanks for sharing with us, I too am always learning something new from your post.

    360DigiTMG Data Science Courses

    ReplyDelete
  24. I have to search sites with relevant information ,This is a
    wonderful blog,These type of blog keeps the users interest in
    the website, i am impressed. thank you.
    Data Science Course in Bangalore

    ReplyDelete
  25. Great article with excellent information found resourceful and enjoyed reading it thank you, looking forward for next blog.
    typeerror nonetype object is not subscriptable

    ReplyDelete
  26. Thanks for sharing great information. I highly recommend you.data science courses

    ReplyDelete
  27. I would like to see video how you do it. Will you post one for me? I can buy youtube likes from this site https://soclikes.com/ for you. What do you say?

    ReplyDelete
  28. Python programming training ensures that students are able to use this highly potential programming language to the best of its capabilities in an exciting and fun way. data science course in india

    ReplyDelete
  29. New site is solid. A debt of gratitude is in order for the colossal exertion.
    Data Science Training in Hyderabad


    ReplyDelete
  30. Great information. The above content is very interesting to read. This will be loved by all age groups.
    fibonacci series
    multilevel inheritance in python

    ReplyDelete
  31. I have been searching to find a comfort or effective procedure to complete this process and I think this is the most suitable way to do it effectively.
    business analytics course

    ReplyDelete
  32. I was pleasantly delighted to discover this blog and what an excellent post it contains. Thank you for sharing.

    Digital Marketing In Telugu

    ReplyDelete
  33. I see some amazingly important and kept up to a length of your strength searching for in your on the site

    Best Data Science courses in Hyderabad

    ReplyDelete
  34. i am glad to discover this page : i have to thank you for the time i spent on this especially great reading !! i really liked each part and also bookmarked you for new information on your site.
    best data science courses in bangalore

    ReplyDelete
  35. I am sure that this is going to help a lot of individuals. Keep up the good work. It is highly convincing and I enjoyed going through the entire blog.

    business analytics course

    ReplyDelete
  36. With special privileges and services, UEFA BET offers opportunities for small capitalists. Together ufa with the best websites that collect the most games With a minimum deposit starting from just 100 baht, you are ready to enjoy the fun with a complete range of betting that is available within the website

    ufabet , our one another option We are a direct website, not through an agent, where customers can have great confidence without deception The best of online betting sites is that our Ufa will give you the best price

    หาคุณกำลังหาเกมส์ออนไลน์ที่สามารถสร้างรายได้ให้กับคุณ เรามีเกมส์แนะนำ เกมยิงปลา รูปแบบใหม่เล่นง่ายบนมือถือ คาสิโนออนไลน์ บนคอม เล่นได้ทุกอุปกรณ์รองรับทุกเครื่องมือ มีให้เลือกเล่นหลายเกมส์ เล่นได้ทั่วโลกเพราะนี้คือเกมส์ออนไลน์แบบใหม่ เกมยิงปลา

    อีกทั้งเรายังให้บริการ เกมสล็อต ยิงปลา แทงบอลออนไลน์ รองรับทุกการใช้งานในอุปกรณ์ต่าง ๆ HTML5 คอมพิวเตอร์ แท็บเล็ต สมาทโฟน คาสิโนออนไลน์ และมือถือทุกรุ่น เล่นได้ตลอด 24ชม. ไม่ต้อง Downloads เกมส์ให้ยุ่งยาก ด้วยระบบที่เสถียรที่สุดในประเทศไทย

    ReplyDelete
  37. I want to leave a little comment to support and wish you the best of luck.we wish you the best of luck in all your blogging enedevors.
    data science course fees in bangalore

    ReplyDelete
  38. This is an awesome motivating article. I am practically satisfied with your great work. You put truly extremely supportive data. Keep it up. Continue blogging. Hoping to pursue your next post

    Best Data Science courses in Hyderabad

    ReplyDelete
  39. Probably the most genuine football betting UFABET that's beyond description Find fun, excitement and excitement with slot video games, hundred totally free recognition, quick withdrawal. If you desire to have fun slots for money No need to deposit a great deal, no minimum, no need to share, squander moment for the reason that UFABET is in fact reduced, given seriously, many great offers are waiting for you. Prepared to ensure pleasurable, regardless of whether it's Joker SlotXo fruit slot, we are able to phone it an internet slot website for you personally especially. Ready to have fun Like the support staff which is going to facilitate slot formulas as well as techniques of actively playing So you will be certain that each minute of fun and pleasure We will be there for one to give your customers the best appearance as well as fulfillment.
    บาคาร่า
    สล็อต
    ufa
    แทงบอล

    ReplyDelete
  40. Thanks for posting the best information and the blog is very important.artificial intelligence course in hyderabad

    ReplyDelete
  41. Interesting post. I Have Been wondering about this issue, so thanks for posting. Pretty cool post.It 's really very nice and Useful post.Thanks
    digital marketing courses in hyderabad with placement

    ReplyDelete
  42. Fantastic article I ought to say and thanks to the info. Instruction is absolutely a sticky topic. But remains one of the top issues of the time. I love your article and look forward to more.
    Data Science Course in Bangalore

    ReplyDelete
  43. Very awesome!!! When I seek for this, I found this website at the top of all blogs in search engine.
    AWS Training in Hyderabad
    AWS Course in Hyderabad

    ReplyDelete
  44. Thank you quite much for discussing this type of helpful informative article. Will certainly stored and reevaluate your Website.
    Data Analytics Course in Bangalore

    ReplyDelete
  45. Tremendous blog quite easy to grasp the subject since the content is very simple to understand. Obviously, this helps the participants to engage themselves in to the subject without much difficulty. Hope you further educate the readers in the same manner and keep sharing the content as always you do.

    data science course in faridabad

    ReplyDelete
  46. A great website with interesting and unique material what else would you need.
    data scientist certification malaysia

    ReplyDelete
  47. It is late to find this act. At least one should be familiar with the fact that such events exist. I agree with your blog and will come back to inspect it further in the future, so keep your performance going.

    Digital Marketing Training in Bangalore

    ReplyDelete
  48. I like reading through a post that will make people think. Also, thank you for permitting me to comment.
    servicenow training in Bangalore

    ReplyDelete
  49. Extremely overall quite fascinating post. I was searching for this sort of data and delighted in perusing this one. Continue posting
    Mulesoft training in hyderabad

    ReplyDelete
  50. Its content is brilliant in many ways. I think it is an attractive and revealing material. Thank you very much for caring about your content and your readers.

    Cloud Computing Institutes in Bangalore

    ReplyDelete
  51. i am glad to discover this page : i have to thank you for the time i spent on this especially great reading !! i really liked each part and also bookmarked you for new information on your site.
    cyber security course in patna

    ReplyDelete
  52. I like this post,And I figure that they having a great time to peruse this post,they might take a decent site to make an information,thanks for sharing it to me ethical hacking course in gurgaon

    ReplyDelete
  53. I want to leave a little comment to support and wish you the best of luck.we wish you the best of luck in all your blogging enedevors
    iot training in delhi

    ReplyDelete
  54. Really nice and interesting post. I was looking for this kind of information and enjoyed reading this one. Keep posting. Thanks for sharing.data science course in bhubaneswar

    ReplyDelete
  55. It's like you've got the point right, but forgot to include your readers. Maybe you should think about it from different angles.

    Data Scientist Course in Nashik

    ReplyDelete
  56. I wanted to leave a little comment to support you and wish you the best of luck. We wish you the best of luck in all of your blogging endeavors.

    Data Analytics Course in Patna

    ReplyDelete
  57. Really nice and interesting post. I was looking for this kind of information and enjoyed reading this one. Keep posting. Thanks for sharing.data scientist course in bhubaneswar

    ReplyDelete
  58. I'm genuinely getting a charge out of scrutinizing your richly formed articles. Apparently you consume a huge load of energy and time on your blog. I have bookmarked it and I am expecting scrutinizing new articles. Continue to do amazing.data science course in ghaziabad

    ReplyDelete
  59. Thank you quite much for discussing this type of helpful informative article. Will certainly stored and reevaluate your Website.
    Data Analytics Course in Bangalore

    ReplyDelete
  60. A decent blog consistently concocts new and energizing data and keeping in mind that perusing I have feel that this blog is truly have each one of those quality that qualify a blog to be a one.https://360digitmg.com/course/certification-program-on-digital-marketing

    ReplyDelete
  61. This is an excellent post I seen thanks to share it. It is really what I wanted to see hope in future you will continue for sharing such a excellent post. Data Science Course in Vadodara

    ReplyDelete
  62. iTop VPN Crack will allow you to securely obtain the global Internet and even surf anonymously - an exceptionally well-known VPN course utilized by hundreds of thousands of Internet clientele to hide their id as well as surf anonymously.

    ReplyDelete
  63. 360DigiTMG, the top-rated organisation among the most prestigious industries around the world, is an educational destination for those looking to pursue their dreams around the globe. The company is changing careers of many people through constant improvement, 360DigiTMG provides an outstanding learning experience and distinguishes itself from the pack. 360DigiTMG is a prominent global presence by offering world-class training. Its main office is in India and subsidiaries across Malaysia, USA, East Asia, Australia, Uk, Netherlands, and the Middle East.

    ReplyDelete

  64. When you have understood the basic concepts of data science, you must choose a path to move in data science. You need to learn the following courses to be an expert in the field of data science.
    data science course in gorakhpur

    ReplyDelete
  65. It is different from the data insight aspect. Algorithms are used to develop data, whereas the executives make better decisions about the product using data insight.
    data science course in lucknow

    ReplyDelete
  66. Start your career preparation with the best Data Science courses offered by 360DigiTMG. Aworld-class curriculum, LMS Access, assignments, and real-time project to grab a high-paying job.
    business analytics course in borivali

    ReplyDelete
  67. This very informative and interesting blog. I have read many blog in days but your writing style is very unique and understanding. if you are interested in home appliances then click below.buy home appliances

    ReplyDelete
  68. You have such a wonderful ability to make people feel valued and appreciated. Buy google suite pricing from google suite pricing

    ReplyDelete