{"id":8553,"date":"2023-07-07T11:59:33","date_gmt":"2023-07-07T11:59:33","guid":{"rendered":"https:\/\/wealthrevelation.com\/data-science\/2023\/07\/07\/monitoring-of-jobskills-with-data-engineering-ai\/"},"modified":"2023-07-07T11:59:33","modified_gmt":"2023-07-07T11:59:33","slug":"monitoring-of-jobskills-with-data-engineering-ai","status":"publish","type":"post","link":"https:\/\/wealthrevelation.com\/data-science\/2023\/07\/07\/monitoring-of-jobskills-with-data-engineering-ai\/","title":{"rendered":"Monitoring of Jobskills with Data Engineering & AI"},"content":{"rendered":"
\n

On own account, we from DATANOMIQ<\/a>\u00a0have created a web application that monitors data about job postings related to Data & AI from multiple sources (Indeed.com, Google Jobs, Stepstone.de and more).<\/p>\n

The data is obtained from the Internet via APIs and web scraping, and the job titles and the skills listed in them are identified and extracted from them using Natural Language Processing<\/strong> (NLP) or more specific from Named-Entity Recognition<\/strong> (NER).<\/p>\n

The skill clusters are formed via the discipline of Topic Modelling<\/strong>, a method from unsupervised machine learning<\/strong>, which show the differences in the distribution of requirements between them.<\/p>\n

\"DATANOMIQ<\/a><\/p>\n

DATANOMIQ Jobskills Webapp<\/a><\/p>\n<\/div>\n

The whole web app is hosted and deployed on the Microsoft Azure Cloud<\/strong> via CI\/CD and Infrastructure as Code (IaC).<\/p>\n

The presentation is currently limited to the current situation on the labor market. However, we collect these over time and will make trends secure, for example how the demand for Python, SQL or specific tools such as dbt or Power BI changes.<\/p>\n

Why we did it? It is a nice show-case many people are interested in. Over the time, it will provides you the answer on your questions related to which tool to learn! For DATANOMIQ<\/a> this is a show-case of the coming Data as a Service<\/strong> (DaaS<\/strong>) Business.<\/em><\/p>\n

About Author<\/h3>\n
\n
\n
\n <\/a>\n <\/div>\n
\n

\n Benjamin Aunkofer<\/a>
\n <\/h4>\n
\n

Benjamin Aunkofer ist Gr\u00fcnder von DATANOMIQ<\/a> und Hochschul-Dozent f\u00fcr Data Science und Data Strategy. Dar\u00fcber hinaus arbeitet er als Interim Head of Business Intelligence und gibt Seminare\/Workshops zu den Themen BI, Data Science und Machine Learning f\u00fcr Unternehmen.<\/p>\n<\/p><\/div>\n<\/p><\/div>\n<\/p><\/div>\n<\/p><\/div>\n<\/p><\/div>\n","protected":false},"excerpt":{"rendered":"

https:\/\/data-science-blog.com\/en\/blog\/2023\/06\/30\/job-skill-monitoring-with-data-engineering-ai\/<\/p>\n","protected":false},"author":0,"featured_media":8554,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":[],"categories":[2],"tags":[],"_links":{"self":[{"href":"https:\/\/wealthrevelation.com\/data-science\/wp-json\/wp\/v2\/posts\/8553"}],"collection":[{"href":"https:\/\/wealthrevelation.com\/data-science\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/wealthrevelation.com\/data-science\/wp-json\/wp\/v2\/types\/post"}],"replies":[{"embeddable":true,"href":"https:\/\/wealthrevelation.com\/data-science\/wp-json\/wp\/v2\/comments?post=8553"}],"version-history":[{"count":0,"href":"https:\/\/wealthrevelation.com\/data-science\/wp-json\/wp\/v2\/posts\/8553\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/wealthrevelation.com\/data-science\/wp-json\/wp\/v2\/media\/8554"}],"wp:attachment":[{"href":"https:\/\/wealthrevelation.com\/data-science\/wp-json\/wp\/v2\/media?parent=8553"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/wealthrevelation.com\/data-science\/wp-json\/wp\/v2\/categories?post=8553"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/wealthrevelation.com\/data-science\/wp-json\/wp\/v2\/tags?post=8553"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}