{ "cells": [ { "cell_type": "markdown", "id": "f6a59636", "metadata": {}, "source": [ "### Data Engineering" ] }, { "cell_type": "code", "execution_count": 1, "id": "93fc3161", "metadata": { "execution": { "iopub.execute_input": "2026-07-05T07:01:35.173273Z", "iopub.status.busy": "2026-07-05T07:01:35.172907Z", "iopub.status.idle": "2026-07-05T07:01:35.847508Z", "shell.execute_reply": "2026-07-05T07:01:35.846478Z" } }, "outputs": [], "source": [ "import pandas as pd" ] }, { "cell_type": "code", "execution_count": 2, "id": "11f11c89", "metadata": { "execution": { "iopub.execute_input": "2026-07-05T07:01:35.851035Z", "iopub.status.busy": "2026-07-05T07:01:35.850637Z", "iopub.status.idle": "2026-07-05T07:01:35.877988Z", "shell.execute_reply": "2026-07-05T07:01:35.876489Z" } }, "outputs": [], "source": [ "df = pd.read_csv(r\"C:\\Portfolio-Projects\\Job-Description-Analysis\\data\\clean\\cleaned_job_descriptions.csv\")" ] }, { "cell_type": "code", "execution_count": 3, "id": "f4334454", "metadata": { "execution": { "iopub.execute_input": "2026-07-05T07:01:35.881169Z", "iopub.status.busy": "2026-07-05T07:01:35.880735Z", "iopub.status.idle": "2026-07-05T07:01:35.902386Z", "shell.execute_reply": "2026-07-05T07:01:35.899923Z" } }, "outputs": [ { "data": { "text/html": [ "
| \n", " | id | \n", "role | \n", "type | \n", "job_desc | \n", "year | \n", "qualification | \n", "experience | \n", "tech_skills | \n", "soft_skills | \n", "
|---|---|---|---|---|---|---|---|---|---|
| 0 | \n", "1 | \n", "AI Engineer | \n", "Internship | \n", "Final year students / recent graduates in CS, ... | \n", "2026 | \n", "Bachelors | \n", "0 | \n", "Python, ML, LangChain, Hugging Face, OpenAI API | \n", "Communication, Problem Solving | \n", "
| 1 | \n", "2 | \n", "AI Engineer | \n", "Internship | \n", "Proficiency in Python and comfort working with... | \n", "2026 | \n", "Bachelors | \n", "0 | \n", "Python, APIs, LLMs, Prompt Engineering, LangCh... | \n", "Communication, Problem Solving | \n", "
| 2 | \n", "3 | \n", "AI Engineer | \n", "Internship | \n", "Strong interest in AI and a willingness to lea... | \n", "2026 | \n", "Bachelors | \n", "0 | \n", "Python, Javascript, React, Full Stack, APIs, M... | \n", "Communication, Problem Solving | \n", "
| 3 | \n", "4 | \n", "AI Engineer | \n", "Senior | \n", "6+ years full-stack software engineering exper... | \n", "2026 | \n", "Not Specified | \n", "5-10 | \n", "Python, Javascript, React, Full Stack, SQL, AP... | \n", "Communication, Problem Solving | \n", "
| 4 | \n", "5 | \n", "AI Engineer | \n", "Junior | \n", "AI/ML models, Python, Core ML concepts, ML fra... | \n", "2026 | \n", "Bachelors | \n", "0-1 | \n", "Python, ML, TensorFlow/PyTorch, Scikit-Learn, ... | \n", "Communication, Problem Solving | \n", "
| 5 | \n", "6 | \n", "AI Engineer | \n", "Junior | \n", "4–5 years of proven development experience in ... | \n", "2026 | \n", "Bachelors | \n", "5-10 | \n", "Python, C++, Java, TensorFlow/PyTorch, vLLM, O... | \n", "Communication, Problem Solving | \n", "
| 6 | \n", "7 | \n", "AI Engineer | \n", "Senior | \n", "5-10 years overall experience\\n3+ years of han... | \n", "2026 | \n", "Not Specified | \n", "5-10 | \n", "Python, SQL, PowerBI, SAP, LLMs, Prompt Engine... | \n", "Communication, Problem Solving | \n", "
| 7 | \n", "8 | \n", "AI Engineer | \n", "Junior | \n", "Proficiency in C/C++ and python programming\\nH... | \n", "2026 | \n", "Bachelors | \n", "0-1 | \n", "Python, C, C++, Sytem Design, Model Evaluation | \n", "Communication, Problem Solving | \n", "
| 8 | \n", "9 | \n", "AI Engineer | \n", "Internship | \n", "Python\\nMachine Learning Fundamentals\\nLarge L... | \n", "2026 | \n", "Bachelors | \n", "0 | \n", "Python, ML, LLMs, Prompt Engineering, APIs, La... | \n", "Communication, Problem Solving | \n", "
| 9 | \n", "10 | \n", "AI Engineer | \n", "Internship | \n", "Solid understanding of LLMs, tokenization, tra... | \n", "2026 | \n", "Bachelors | \n", "0 | \n", "Python, Pandas, NumPyHugging Face, LangChain, ... | \n", "Communication, Problem Solving | \n", "
| \n", " | id | \n", "role | \n", "type | \n", "job_desc | \n", "year | \n", "qualification | \n", "experience | \n", "tech_skills | \n", "soft_skills | \n", "
|---|---|---|---|---|---|---|---|---|---|
| 0 | \n", "1 | \n", "AI Engineer | \n", "Internship | \n", "Final year students / recent graduates in CS, ... | \n", "2026 | \n", "Bachelors | \n", "0 | \n", "Python, ML, LangChain, Hugging Face, OpenAI API | \n", "Communication, Problem Solving | \n", "
| 1 | \n", "2 | \n", "AI Engineer | \n", "Internship | \n", "Proficiency in Python and comfort working with... | \n", "2026 | \n", "Bachelors | \n", "0 | \n", "Python, APIs, LLMs, Prompt Engineering, LangCh... | \n", "Communication, Problem Solving | \n", "
| 2 | \n", "3 | \n", "AI Engineer | \n", "Internship | \n", "Strong interest in AI and a willingness to lea... | \n", "2026 | \n", "Bachelors | \n", "0 | \n", "Python, Javascript, React, Full Stack, APIs, M... | \n", "Communication, Problem Solving | \n", "
| 8 | \n", "9 | \n", "AI Engineer | \n", "Internship | \n", "Python\\nMachine Learning Fundamentals\\nLarge L... | \n", "2026 | \n", "Bachelors | \n", "0 | \n", "Python, ML, LLMs, Prompt Engineering, APIs, La... | \n", "Communication, Problem Solving | \n", "
| 9 | \n", "10 | \n", "AI Engineer | \n", "Internship | \n", "Solid understanding of LLMs, tokenization, tra... | \n", "2026 | \n", "Bachelors | \n", "0 | \n", "Python, Pandas, NumPyHugging Face, LangChain, ... | \n", "Communication, Problem Solving | \n", "
| 12 | \n", "13 | \n", "AI Developer | \n", "Internship | \n", "Basic to intermediate Python programming skill... | \n", "2026 | \n", "Bachelors | \n", "0 | \n", "Python, ML, GenAI, APIs, Git, Prompt Engineeri... | \n", "Communication, Problem Solving, Analytical Skills | \n", "
| 25 | \n", "27 | \n", "AI Engineer | \n", "Internship | \n", "Python Skills: You should be very comfortable ... | \n", "2026 | \n", "Bachelors | \n", "0 | \n", "Python, Javascript, React, LLMs, VectorDB, Lan... | \n", "Communication, Problem Solving | \n", "
| 26 | \n", "28 | \n", "AI Engineer | \n", "Internship | \n", "Exposure to Full-Stack Development (frontend a... | \n", "2026 | \n", "Bachelors | \n", "0 | \n", "Python, Git, Github, Full Stack, LLMs, APIs, G... | \n", "Communication, Problem Solving, Analytical Skills | \n", "
| 27 | \n", "29 | \n", "AI Engineer | \n", "Internship | \n", "Python, TensorFlow, PyTorch, Scikit-learn, Num... | \n", "2026 | \n", "Bachelors | \n", "0 | \n", "Python, TensorFlow/PyTorch, Scikit-Learn, NumP... | \n", "Communication, Problem Solving | \n", "
| 28 | \n", "30 | \n", "AI Engineer | \n", "Internship | \n", "Recently completed a degree in Computer Scienc... | \n", "2026 | \n", "Bachelors | \n", "0 | \n", "Python, GenAI, LLMs, RAG, Prompt Engineering, ... | \n", "Communication, Problem Solving, Analytical Skills | \n", "
| \n", " | id | \n", "role | \n", "type | \n", "job_desc | \n", "year | \n", "qualification | \n", "experience | \n", "tech_skills | \n", "soft_skills | \n", "
|---|---|---|---|---|---|---|---|---|---|
| 0 | \n", "1 | \n", "AI Engineer | \n", "Internship | \n", "Final year students / recent graduates in CS, ... | \n", "2026 | \n", "Bachelors | \n", "0 | \n", "Python, ML, LangChain, Hugging Face, OpenAI API | \n", "Communication, Problem Solving | \n", "
| 1 | \n", "2 | \n", "AI Engineer | \n", "Internship | \n", "Proficiency in Python and comfort working with... | \n", "2026 | \n", "Bachelors | \n", "0 | \n", "Python, APIs, LLMs, Prompt Engineering, LangCh... | \n", "Communication, Problem Solving | \n", "
| 2 | \n", "3 | \n", "AI Engineer | \n", "Internship | \n", "Strong interest in AI and a willingness to lea... | \n", "2026 | \n", "Bachelors | \n", "0 | \n", "Python, Javascript, React, Full Stack, APIs, M... | \n", "Communication, Problem Solving | \n", "
| 8 | \n", "9 | \n", "AI Engineer | \n", "Internship | \n", "Python\\nMachine Learning Fundamentals\\nLarge L... | \n", "2026 | \n", "Bachelors | \n", "0 | \n", "Python, ML, LLMs, Prompt Engineering, APIs, La... | \n", "Communication, Problem Solving | \n", "
| 9 | \n", "10 | \n", "AI Engineer | \n", "Internship | \n", "Solid understanding of LLMs, tokenization, tra... | \n", "2026 | \n", "Bachelors | \n", "0 | \n", "Python, Pandas, NumPyHugging Face, LangChain, ... | \n", "Communication, Problem Solving | \n", "
| 12 | \n", "13 | \n", "AI Developer | \n", "Internship | \n", "Basic to intermediate Python programming skill... | \n", "2026 | \n", "Bachelors | \n", "0 | \n", "Python, ML, GenAI, APIs, Git, Prompt Engineeri... | \n", "Communication, Problem Solving, Analytical Skills | \n", "
| 25 | \n", "27 | \n", "AI Engineer | \n", "Internship | \n", "Python Skills: You should be very comfortable ... | \n", "2026 | \n", "Bachelors | \n", "0 | \n", "Python, Javascript, React, LLMs, VectorDB, Lan... | \n", "Communication, Problem Solving | \n", "
| 26 | \n", "28 | \n", "AI Engineer | \n", "Internship | \n", "Exposure to Full-Stack Development (frontend a... | \n", "2026 | \n", "Bachelors | \n", "0 | \n", "Python, Git, Github, Full Stack, LLMs, APIs, G... | \n", "Communication, Problem Solving, Analytical Skills | \n", "
| 27 | \n", "29 | \n", "AI Engineer | \n", "Internship | \n", "Python, TensorFlow, PyTorch, Scikit-learn, Num... | \n", "2026 | \n", "Bachelors | \n", "0 | \n", "Python, TensorFlow/PyTorch, Scikit-Learn, NumP... | \n", "Communication, Problem Solving | \n", "
| 28 | \n", "30 | \n", "AI Engineer | \n", "Internship | \n", "Recently completed a degree in Computer Scienc... | \n", "2026 | \n", "Bachelors | \n", "0 | \n", "Python, GenAI, LLMs, RAG, Prompt Engineering, ... | \n", "Communication, Problem Solving, Analytical Skills | \n", "
| \n", " | id | \n", "role | \n", "type | \n", "job_desc | \n", "year | \n", "qualification | \n", "experience | \n", "tech_skills | \n", "soft_skills | \n", "
|---|---|---|---|---|---|---|---|---|---|
| 4 | \n", "5 | \n", "AI Engineer | \n", "Junior | \n", "AI/ML models, Python, Core ML concepts, ML fra... | \n", "2026 | \n", "Bachelors | \n", "0-1 | \n", "Python, ML, TensorFlow/PyTorch, Scikit-Learn, ... | \n", "Communication, Problem Solving | \n", "
| 5 | \n", "6 | \n", "AI Engineer | \n", "Junior | \n", "4–5 years of proven development experience in ... | \n", "2026 | \n", "Bachelors | \n", "5-10 | \n", "Python, C++, Java, TensorFlow/PyTorch, vLLM, O... | \n", "Communication, Problem Solving | \n", "
| 7 | \n", "8 | \n", "AI Engineer | \n", "Junior | \n", "Proficiency in C/C++ and python programming\\nH... | \n", "2026 | \n", "Bachelors | \n", "0-1 | \n", "Python, C, C++, Sytem Design, Model Evaluation | \n", "Communication, Problem Solving | \n", "
| 13 | \n", "14 | \n", "AI Engineer | \n", "Junior | \n", "Basic understanding of AI, Machine Learning, o... | \n", "2026 | \n", "Bachelors | \n", "0-1 | \n", "Python, ML, APIs | \n", "Communication, Problem Solving | \n", "
| 15 | \n", "16 | \n", "AI Engineer | \n", "Junior | \n", "Docker / Containerization\\nAWS / Azure / GCP e... | \n", "2026 | \n", "Bachelors | \n", "0-1 | \n", "Python, ML, Docker, AWS/Azure, | \n", "Communication, Problem Solving | \n", "
| 16 | \n", "17 | \n", "AI Engineer | \n", "Junior | \n", "1+ years of experience in AI, LLMs, automation... | \n", "2026 | \n", "Bachelors | \n", "1-5 | \n", "Python, APIs, LLMs, Prompt Engineering, LangCh... | \n", "Communication, Problem Solving, Ownership | \n", "
| 17 | \n", "18 | \n", "AI Developer | \n", "Junior | \n", "Strong Python programming\\nExperience with Fas... | \n", "2026 | \n", "Bachelors | \n", "0-1 | \n", "Python, React, Javascript, APIs, AWS/Azure, LL... | \n", "Communication, Problem Solving | \n", "
| 18 | \n", "19 | \n", "AI Engineer | \n", "Junior | \n", "Degree in Computer Science, AI, or a related f... | \n", "2026 | \n", "Bachelors | \n", "0-1 | \n", "Python, Javascript, LLMs, Prompt Engineering,... | \n", "Communication, Problem Solving | \n", "
| 21 | \n", "22 | \n", "AI Engineer | \n", "Junior | \n", "Strong programming skills in Python.\\nExperien... | \n", "2026 | \n", "Bachelors | \n", "0-1 | \n", "Python, LLMs, Prompt Engineering, RAG, TensorF... | \n", "Communication, Problem Solving | \n", "
| 24 | \n", "26 | \n", "AI Engineer | \n", "Junior | \n", "Strong hands-on experience in Python programmi... | \n", "2026 | \n", "Bachelors | \n", "0-1 | \n", "Python, APIs, GenAI, LLMs, Pandas, NumPy, Scik... | \n", "Communication, Problem Solving | \n", "
| \n", " | id | \n", "role | \n", "type | \n", "job_desc | \n", "year | \n", "qualification | \n", "experience | \n", "tech_skills | \n", "soft_skills | \n", "
|---|---|---|---|---|---|---|---|---|---|
| 3 | \n", "4 | \n", "AI Engineer | \n", "Senior | \n", "6+ years full-stack software engineering exper... | \n", "2026 | \n", "Not Specified | \n", "5-10 | \n", "Python, Javascript, React, Full Stack, SQL, AP... | \n", "Communication, Problem Solving | \n", "
| 6 | \n", "7 | \n", "AI Engineer | \n", "Senior | \n", "5-10 years overall experience\\n3+ years of han... | \n", "2026 | \n", "Not Specified | \n", "5-10 | \n", "Python, SQL, PowerBI, SAP, LLMs, Prompt Engine... | \n", "Communication, Problem Solving | \n", "
| 10 | \n", "11 | \n", "AI Engineer | \n", "Senior | \n", "4–6 years of experience in Data Science / Mach... | \n", "2026 | \n", "Not Specified | \n", "5-10 | \n", "Python, Scikit-Learn, Pandas, NumPy, ML, LLMs,... | \n", "Communication, Problem Solving | \n", "
| 11 | \n", "12 | \n", "AI Engineer | \n", "Senior | \n", "Bachelor's or Master's degree in Computer Scie... | \n", "2026 | \n", "Bachelors/Masters | \n", "1-5 | \n", "Python, ML, APIs, GenAI, LangChain, LangGraph,... | \n", "Communication, Problem Solving, Analytical Skills | \n", "
| 14 | \n", "15 | \n", "AI Engineer | \n", "Senior | \n", "4–6 years of experience in Data Science / Mach... | \n", "2026 | \n", "Not Specified | \n", "5-10 | \n", "Python, ML, Pandas, NumPy, Scikit-Learn, GenAI... | \n", "Communication, Problem Solving | \n", "
| 19 | \n", "20 | \n", "AI Engineer | \n", "Senior | \n", "Proven track record with at least 5 years of e... | \n", "2026 | \n", "Not Specified | \n", "1-5 | \n", "Python, ML, NLP, MLOps, Feature Engineering, A... | \n", "Communication, Problem Solving | \n", "
| 20 | \n", "21 | \n", "AI Engineer | \n", "Senior | \n", "5+ years overall experience in software develo... | \n", "2026 | \n", "Not Specified | \n", "5-10 | \n", "Python, APIs, LLMs, Prompt Engineering, LangCh... | \n", "Communication, Problem Solving | \n", "
| 22 | \n", "24 | \n", "AI Developer | \n", "Senior | \n", "Core Software Engineering (Required)\\nStrong h... | \n", "2026 | \n", "Not Specified | \n", "5-10 | \n", "Python, Javascript, AWS/Azure, VectorDB, LLMs,... | \n", "Communication, Problem Solving | \n", "
| 23 | \n", "25 | \n", "AI Engineer | \n", "Senior | \n", "15+ years of overall IT experience\\nStrong exp... | \n", "2026 | \n", "Not Specified | \n", "15+ | \n", "Python, ML, APIs, AWS/Azure, CI/CD, Github, Git, | \n", "Communication, Problem Solving | \n", "
| 29 | \n", "31 | \n", "AI Developer | \n", "Senior | \n", "trong hands-on experience in Python backend de... | \n", "2026 | \n", "Bachelors | \n", "5-10 | \n", "Python, LangChain, LangGraph, CrewAI, AutoGen,... | \n", "Communication, Problem Solving | \n", "
| 30 | \n", "32 | \n", "AI Developer | \n", "Senior | \n", "To qualify for the role you must have B.E/ B.T... | \n", "2026 | \n", "Masters | \n", "5-10 | \n", "Python, ML, AWS/Azure, SQL, Docker, Kubernete... | \n", "Communication, Problem Solving | \n", "
| 31 | \n", "33 | \n", "AI Developer | \n", "Senior | \n", "• 3–6 years of software development experience... | \n", "2026 | \n", "Not Specified | \n", "5-10 | \n", "Python, APIs, SQL, LLMs, Prompt Engineering, R... | \n", "Communication, Problem Solving | \n", "
| 32 | \n", "34 | \n", "AI Engineer | \n", "Senior | \n", "- Experience in publishing research or contrib... | \n", "2026 | \n", "Masters | \n", "5-10 | \n", "Python, GenAI, LLMs | \n", "Communication, Problem Solving | \n", "
| 40 | \n", "42 | \n", "AI Engineer | \n", "Senior | \n", "Python · JS/TS · Neo4j/Cypher · MongoDB · Post... | \n", "2026 | \n", "Not Specified | \n", "1-5 | \n", "Python, Javascript, SQL, LLMs, APIs, VectorDB,... | \n", "Communication, Problem Solving | \n", "
| 42 | \n", "44 | \n", "AI Engineer | \n", "Senior | \n", "You will focus on creating reusable agent arch... | \n", "2026 | \n", "Not Specified | \n", "5-10 | \n", "Python, ML, APIs, LLMs, LangChain, LangGraph, ... | \n", "Communication, Problem Solving | \n", "
| \n", " | id | \n", "role | \n", "type | \n", "job_desc | \n", "year | \n", "qualification | \n", "experience | \n", "tech_skills | \n", "soft_skills | \n", "
|---|---|---|---|---|---|---|---|---|---|
| 12 | \n", "13 | \n", "AI Developer | \n", "Internship | \n", "Basic to intermediate Python programming skill... | \n", "2026 | \n", "Bachelors | \n", "0 | \n", "Python, ML, GenAI, APIs, Git, Prompt Engineeri... | \n", "Communication, Problem Solving, Analytical Skills | \n", "
| 17 | \n", "18 | \n", "AI Developer | \n", "Junior | \n", "Strong Python programming\\nExperience with Fas... | \n", "2026 | \n", "Bachelors | \n", "0-1 | \n", "Python, React, Javascript, APIs, AWS/Azure, LL... | \n", "Communication, Problem Solving | \n", "
| 22 | \n", "24 | \n", "AI Developer | \n", "Senior | \n", "Core Software Engineering (Required)\\nStrong h... | \n", "2026 | \n", "Not Specified | \n", "5-10 | \n", "Python, Javascript, AWS/Azure, VectorDB, LLMs,... | \n", "Communication, Problem Solving | \n", "
| 29 | \n", "31 | \n", "AI Developer | \n", "Senior | \n", "trong hands-on experience in Python backend de... | \n", "2026 | \n", "Bachelors | \n", "5-10 | \n", "Python, LangChain, LangGraph, CrewAI, AutoGen,... | \n", "Communication, Problem Solving | \n", "
| 30 | \n", "32 | \n", "AI Developer | \n", "Senior | \n", "To qualify for the role you must have B.E/ B.T... | \n", "2026 | \n", "Masters | \n", "5-10 | \n", "Python, ML, AWS/Azure, SQL, Docker, Kubernete... | \n", "Communication, Problem Solving | \n", "
| 31 | \n", "33 | \n", "AI Developer | \n", "Senior | \n", "• 3–6 years of software development experience... | \n", "2026 | \n", "Not Specified | \n", "5-10 | \n", "Python, APIs, SQL, LLMs, Prompt Engineering, R... | \n", "Communication, Problem Solving | \n", "
| 33 | \n", "35 | \n", "AI Developer | \n", "Junior | \n", "Strong foundation in Java, React, NodeJS, Pyth... | \n", "2026 | \n", "Bachelors | \n", "0-1 | \n", "Java, React, NodeJS, Python, SQL, Excel, Pand... | \n", "Problem Solving, Strong analytical, logical th... | \n", "
| 47 | \n", "49 | \n", "AI Developer | \n", "Internship | \n", "1. Building event-driven automations to captur... | \n", "2026 | \n", "Bachelors | \n", "0 | \n", "Python, LLMs, ML, APIs, n8n, GenAI | \n", "Communication, Problem Solving | \n", "
| 48 | \n", "50 | \n", "AI Developer | \n", "Internship | \n", "• Currently pursuing a bachelor's or master's ... | \n", "2026 | \n", "Bachelors | \n", "0 | \n", "Python, LLMs, GenAI, ML, Agents | \n", "Communication, Problem Solving | \n", "
| 49 | \n", "51 | \n", "AI Developer | \n", "Internship | \n", "• Basic knowledge of Python programming.\\n• Un... | \n", "2026 | \n", "Bachelors | \n", "0 | \n", "Python, ML, GenAI, LLMs, NLP, APIs, TensorFlow... | \n", "Communication, Problem Solving | \n", "