Hello, I want to create a project showcasing my Cloud platform skills, I don’t know what should I host there? I can’t just host random open source projects there and call it a day since it will not utilize all the functionality of the Cloud instead it will just utilize a single EC2 instance and that’s it.
I have an idea though, I am thinking about making a youtube video using Java + yt-dlp so basically I will use Java (Spring boot) to create the API and yt-dlp to actually download the videos. It will also cache the videos so it will be utilizing S3 bucket to store/cache the downloaded youtube video so that when another person requests the same video we can just sent the video from the S3 bucked instead of fetching it from YouTube servers. so far this is the thing that came to my mind, This project will utilize EC2 instance and S3 bucket. if anyone has any good idea please do share 🙂
Having yt-dlp save the videos to S3 will just add to your costs - what benefit will it provide to your users to get the file from S3 compared to Youtube?
While ‘cloud computing’ is managing servers in the cloud like EC2, they’re still just servers like you’d run in your lab. To do it the ‘cloud way’, use the cloud services instead.
My suggestion would be a price checker - create a webpage maybe with S3 or Lightsail where users can enter in a URL for a product, an email address and a scrape recurrence time like 24hours, then have Lambda scrape the page & email the price to the user on that schedule. Use DynamoDB (or a relational DB like Postgresql) to save the results, schedule, etc.
Try not to use EC2 at all if possible. Or instead of EC2, use EKS if scraping with Lambda is too difficult.
The most important thing is getting the security right, from your access to AWS to ensuring your database isn’t easily downloaded by just anyone.