Arezoo Alipanah
Robotics Engineer
Reinforcement Learning Researcher
Python Tutor
- E-mailarezoo.alip@gmail.com
- LinkedInArezoo Alipanah
- ResearchGateArezoo Alipanah
- Phone+98 914 454 9503
- FreelanceAvailable
About Me
Researcher, Programmer, Thinker, Creative Doer
I am a Research Assistant @ K. N. Toosi University of Technology
My research is mainly based on Reinforcement learning implementation in robotic systems, improving off-policy methods, and combining on-policy ones with supervised learning. Currently, my main focus is on the applications of deep reinforcement learning on mobile robot navigation via using sensor data in a mapless environment. My job is mostly simulation-based and done via ROS(Robot Operating System) in the Gazebo environment. My Master's thesis was under the supervision of S. A. A. Moosavian at K.N.Toosi University. More specifically, I study the following topics:
1. Deep Reinforcement Learning
2. Off-policy policy evaluation and optimization
3. Application of RL on path planning
Motto (some of my favourite book quotes)
"What is a person, if not the marks they leave behind?"
"So we'll train, Feyre, until the last possible day. Because we never know if just one extra hour will make thedifference."
"We've all got both light and dark inside us. What matters is the part we choose to act on. That's who we really are."
"The people who are crazy enough to think they can change the world are the ones who do."
"Somewhere inside all of us is the power to change the world."
Specialities
Robotics Engineer
I usually consider my robot simulations as "my children." Always captivated with how much I can do with ROS, I am eager to test different algorithms in different robots and help them to be a help to humanity.
Programmer
Since the day I was able to print that "Hello World!" expression, I have never found myself tired of coding. Sometimes it even becomes my comfort zone since I go so concentrated that I forget what's happening in the world.
Researcher
Always fascinated by solving new challenges and finding better solutions for different problems, I am in love with going deep into different areas and trying to contribute as much as possible.
Tutor
I used to be a section leader for Python in Stanford Code place. Once a student mentioned that I have made him "believe in himself, and now he really can code." since then, I have tried to be devoted to helping others in areas that are my specialties.
Content Creator
Sharing my experiences and telling stories is always so fun to me, which sometimes leads me to post commentary videos or book reviews on YouTube.
Reader
Always eager to dive into new worlds, people usually find me with either a book in my hand or an audiobook in my ears.
Translator
Being a bilingual (Persian and Azeri) alongside proficiency in English has allowed me to create a bridge between these languages and contribute to helping others to cross this bridge:)
Gamedev Hobbyist
Interested in making my dream game, I sometimes spend time on game development with Unity and Godot.
Have Had a Role in:
Fun Facts
Happy Students
78Working Hours
5,259Boooks Read
300Years of Study
19Resume
Education
2019-2022
M.Sc. in Mechanical Engineering, Dynamics and Control
K. N. Toosi University of TechnologyOverall GPA: 17.87/20 (4.0/4.0)
Thesis: Mobile Robot's Path Planning in Dynamic Environments With Machine Learning
2015-2019
B.Sc. in Mechanical Engineering
Shahid Beheshti UniversityOverall GPA: 17.58/20 (3.77/4.0)
Thesis: Bearing Fault Diagnosis Using Machine Learning
2011-2015
Diploma in Mathematics and Physics
National Organization for Development of Exceptional Talents (NODET)Total GPA: 19.49/20
Experience
2020 - Current
Research Assistant
Advanced Robotics and Automated Systems (ARAS) LaboratoryProf. S.A.A. Moosavian
Research Area: Reinforcement Learning, Path Planning, Robotics, and Control
2020 -2022
Graduate Teaching Assistant
KNTUTeaching assistant of Control in Robotics, Prof. S. A. A. Moosavian
Teaching assistant of Dynamics, Prof. S. A. A. Moosavian
Teaching assistant of Advanced Engineering Mathematics, Dr. S. H. Sadati
2021
Python Tutor
Code in PlaceThis online course was offered by Stanford University during the COVID-19 pandemic. The course is a 6-week introduction to Python programming using materials from the first half of Stanford’s CS106A course. As a volunteer section leader, I prepared and taught a weekly discussion section of 8-10 students to supplement professors' lectures.
Robotics Skills
ROS
Gazebo
MSC Adams
SOLIDWORKS
Coding Skills and Deep Learning Frameworks:
Python
MATLAB
Unix shell scripts
JavaScript(some uses)
C#(some uses)
C++(some uses)
TensorFlow
PyTorch(some uses)
Other Skills:
HTML
CSS(some uses)
LaTeX
Microsoft Office
Adobe Photoshop(some uses)
Adobe Premiere Pro
Unity
Portfolio
Some of My Works
MSc Thesis: Mobile Robot's Path Planning in Dynamic Environments With Machine Learning
Research
Designing a Fuzzy Logic Controller for Car Parallel Parking
Research
3RPS Parallel Manipulator Kinematics, Dynamics, and Motion/Force Control
Research
BSc Thesis: Bearing Fault Diagnosis With Signal Processing and Machine Learning
Research
Paper Revision: "Easy-GT: Open-Source Software to Facilitate Making the Ground Truth for White Blood Cells Nucleus"
Research
Code in Place Section Leader
Certificate
Practical Reinforcement Learning by HSE, Coursera
Certificate
Deep Learning by Andrew Ng, Coursera
Certificate
ROS & Gazebo, Maktabkhoone
Certificate
GRE General Test, ETS
Certificate
TOEFL iBT, ETS
Certificate
Building a Deep Q-Network for Training Atari 2600 VCS Breakout
Project
Using Advantage Actor-Critic for Training Agent to Play Atari Kung-Fu Master
Project
Translation of Hebrew words in English(g2p) with a policy-based DRL method
Project
Implementation of Deep Cross Entropy Method in Gym Environments
Project
Building a web page like Google Keep
Project
Making a Simple 2D Platformer Game in Unity
Project
Building The Brick Breaker Game from Scratch
Project
AL5B Serial Manipulator Kinematics, Dynamics, Motion/Force, and Impedance Control
Project
Deep Neural Network for Image Classification
Project
Implementing Canny Edge Detection on a particular set from the KITTI dataset
Video
Implementing a Path Tracking Algorithm on the Turtle in Turtlesim | ROS
Video
CartPole via policy gradient (REINFORCE)
VideoBlog
My Thoughts
Contact
Get in Touch
Get in Touch
I am available for Research Projects in robotics, reinforcement learning, and machine learning applications in robots. You can also contact me if you need tutoring in Python, RL (theory and code), ROS, and Practical Machine Learning.
I am also eager to step into whole new worlds in my free time, so do not hesitate to contact me for a discussion about exciting projects you have in mind.
You can find me via these connection ways( I usually do not check my email more than once a week, so for urgent calls, you can put your contact info and a detailed message explaining what you have in your mind, and I will contact you for further discussion):