releng/tickets
15
3
Fork 2
Code Issues 88 Pull requests Projects Releases Packages Wiki Activity Actions

Script to delete the nightly AMIs periodically #6613

Merged
jnsamyak merged 3 commits from clean-amis into master 2026-06-08 03:12:42 +00:00
Conversation 9 Commits 3 Files changed 1 +193
sayanchowdhury commented 2017-02-02 15:45:20 +00:00
Contributor
Copy link

The nightly AMIs right now gets accumulated over time and needs to be deleted manually. This script will run as cron and:

  • remove the launch permissions of the AMIs after 5 days.
  • after the next 5 days, the AMIs whose launch permission where removed will be deleted.

This script needs to tested before actually deployment. The script has a --dry-run option which just prints the ami_id which would have been effected by that operation.

The nightly AMIs right now gets accumulated over time and needs to be deleted manually. This script will run as cron and: - remove the launch permissions of the AMIs after 5 days. - after the next 5 days, the AMIs whose launch permission where removed will be deleted. This script needs to tested before actually deployment. The script has a `--dry-run` option which just prints the ami_id which would have been effected by that operation.
dustymabe commented 2017-02-07 02:49:17 +00:00
Member
Copy link

10 days in the state of "no launch permission" would be more desirable to me

10 days in the state of "no launch permission" would be more desirable to me
pfrields commented 2017-02-22 15:42:53 +00:00
Contributor
Copy link

@sayanchowdhury told me he's working on this PR this week, now that he's back from PyCon Pune.

@sayanchowdhury told me he's working on this PR this week, now that he's back from PyCon Pune.
ausil commented 2017-02-28 20:36:13 +00:00
Contributor
Copy link

how is this supposed to be integrated into our processes?

how is this supposed to be integrated into our processes?
sayanchowdhury commented 2017-03-01 14:26:05 +00:00
Author
Contributor
Copy link

rebased

rebased
sayanchowdhury commented 2017-03-01 14:33:27 +00:00
Author
Contributor
Copy link

I've updated the script as @dustymabe pointed out.

This script will keep running separately as a cron. One thing that I will be adding after a few successful run of this script is that after the final release, the script is needed to be run to delete the pre-released (Alpha, Beta) AMIs.

I've updated the script as @dustymabe pointed out. This script will keep running separately as a cron. One thing that I will be adding after a few successful run of this script is that after the final release, the script is needed to be run to delete the pre-released (Alpha, Beta) AMIs.
sayanchowdhury commented 2017-03-24 12:55:28 +00:00
Author
Contributor
Copy link

Any update on this ticket? It's been a long time we have done the cleanup of the AMIs and there should have been a huge backlog of snapshots.

Any update on this ticket? It's been a long time we have done the cleanup of the AMIs and there should have been a huge backlog of snapshots.
pfrields commented 2017-08-08 13:20:25 +00:00
Contributor
Copy link

This really needs to get reviewed and merged. It's been many months, and in the meantime our EC2 EBS costs (snapshot image storage) have been mounting up, almost doubling in that time frame. This potentially puts the generous donation from our friends at Amazon at risk. Could someone in @releng resolve this please?

This really needs to get reviewed and merged. It's been many months, and in the meantime our EC2 EBS costs (snapshot image storage) have been mounting up, almost doubling in that time frame. This potentially puts the generous donation from our friends at Amazon at risk. Could someone in @releng resolve this please?
maxamillion commented 2017-08-08 14:19:45 +00:00
Contributor
Copy link

Some of us spoke on IRC and came up with a plan, for now @puiterwijk will provision us limited AWS tokens in order to run this with cron on compose-x86-01 and then we'll move to loopabull once that's available.

Merging.

Some of us spoke on IRC and came up with a plan, for now @puiterwijk will provision us limited AWS tokens in order to run this with cron on compose-x86-01 and then we'll move to loopabull once that's available. Merging.
maxamillion commented 2017-08-08 14:19:58 +00:00
Contributor
Copy link

Pull-Request has been merged by maxamillion

Pull-Request has been merged by maxamillion
Sign in to join this conversation.
Reviewers
No reviewers
Labels
Clear labels   
after freeze

   
automation

   
backlog
Tasks that will take longer then ~4 hours to do

  
blocked

   
change-ack
Changes that have releng work and are accepted

  
change-nak
Changes that have releng work and have been rejected

  
change-noreleng
Changes that do not have any releng work

  
changes
  
Closed As
Can't Fix
 Closed with the reason of Can't Fix

  
Closed As
Duplicate
 Closed with the reason of Duplicate

  
Closed As
Fixed
 Closed with the reason of Fixed

  
Closed As
Fixed with Explanation
 Closed with the reason of Fixed with Explanation

  
Closed As
Get back later
 Closed with the reason of Get back later

  
Closed As
Grooming
 Closed with the reason of Grooming

  
Closed As
Insufficient data
 Closed with the reason of Insufficient data

  
Closed As
Invalid
 Closed with the reason of Invalid

  
Closed As
It's all good
 Closed with the reason of It's all good

  
Closed As
taiga
 Closed with the reason of taiga

  
Closed As
upstream
 Closed with the reason of upstream

  
day-to-day
These are small, self-contained tasks that are part of normal operations but are async from sprint planning.

  
dev

   
docs

   
easyfix

   
epel

   
f26

   
f27
Fedora 27

  
f28
Fedora 28

  
f29
Fedora 29

  
f30

   
f31

   
f32

   
f33
Fedora 33

  
f34

   
f35
Fedora 35

  
f36

   
f37

   
f38

   
f39
Fedora 39

  
f40

   
f41
Fedora 41

  
f42
Fedora 42

  
f43
Fedora 43

  
f44
Fedora 44

  
f45
Fedora 45

  
fedora

   
groomed

   
high-gain

   
high-trouble

   
in-progress

   
in-review

   
investigation

   
legal

   
low-gain

   
low-trouble

   
mass rebuild

   
medium-gain

   
medium-trouble

   
meeting

   
mini-initiative

   
new_artifact
New artifact for fedora release

  
ops

   
pdc_retirement

   
rawhide

   
RCA
Root cause analysis

  
review

   
script

   
sidetarget

   
sprint-0

   
sprint-1
Releng Sprint 1 Tracker

  
sprint-2
Sprint 2

  
sprint-3
Releng Sprint 3 Tracker

  
sprint-4
RelEng Spring 4 Tracker

  
sprint-5
RelEng Sprint Tracker 5 (Nov 18 - Dec 02)

  
unfrozen
Revisit after freeze

  
waiting on external
  
Backlog Status
Needs Review
 Needs to go through refinement

  
Backlog Status
Ready
 Ready for sprint

  
chore

   
documentation
  
points
01
 A task that is simple, small, and has very little uncertainty. It should be easy enough for any team member to pick up and complete quickly, without a lot of discussion or research.

  
points
02
 This is a task that is slightly more complex or larger than a "1." It might involve two or three simple steps, but the outcome is still very clear and there's little uncertainty.

  
points
03
 Medium-sized task with some noticeable complexity. It might require a bit more thought or collaboration. The steps are well-defined, but it's not a trivial change.

  
points
05
 A significant piece of work. It has more complexity and a higher degree of uncertainty than smaller tasks. It might require some research, a design discussion, or collaboration across multiple teams.

  
points
08
 Complex task with a lot of uncertainty. It's often the largest size that a team will consider for a single sprint. It likely requires a detailed breakdown and multiple team members to complete.

  
points
13
 Any task that feels like it's a "13" or more is considered an Epic. These are too large and uncertain to be worked on in a single sprint and should be broken down.

  
Priority
High
 This is for work that is critical and needs to be addressed in the next sprint. It's often for urgent bugs, important features, or a major piece of technical debt that is blocking other work.

  
Priority
Low
 This is for work that is good to do but not urgent. It's a candidate for being worked on when there's extra time or when it rises in importance. It can stay in the backlog for a longer period.

  
Priority
Medium
 This is for important work that should be done soon, but isn't as urgent as a high-priority item. It will likely be considered for the next 1-2 sprints.

  
Sprint Status
Blocked
 Work items that cannot progress due to external dependencies, blockers, or issues that need resolution.

  
Sprint Status
Done
 Work items that have been completed, reviewed, and integrated. No further work is needed within the current sprint.

  
Sprint Status
In Progress
 Work items currently being worked on by a team member. Active development, research, or implementation is happening.

  
Sprint Status
Review
 Work items that are complete but need review, testing, or approval before being marked as done.

  
Sprint Status
To Do
 Work items that are committed to the sprint but haven't been started yet. These items are ready to be picked up by team members.

  
Technical Debt
Work that addresses shortcuts, workarounds, or suboptimal implementations that were done previously to meet deadlines. These items improve code quality, maintainability, or performance without adding new features.

  
Work Item
Bug
 Issues where the system is not working as intended or designed. Bugs represent deviations from expected behavior.

  
Work Item
Epic
 Large initiatives that are broken down into multiple smaller work items (user stories, tasks, bugs). Epics represent significant features or projects that span multiple sprints.

  
Work Item
Spike
 Time-boxed research, investigation, or proof-of-concept work to reduce uncertainty or explore solutions. Spikes help inform future development decisions.

  
Work Item
Task
 Used to break down larger user stories into smaller, manageable implementation pieces. They focus on the specific technical steps needed to deliver the user story's value.

  
Work Item
User Story
 User-facing features or functionality that can be framed from a user perspective, describing what someone wants to accomplish and why.

No labels
after freeze
automation
backlog
blocked
change-ack
change-nak
change-noreleng
changes
Closed As
Can't Fix
Closed As
Duplicate
Closed As
Fixed
Closed As
Fixed with Explanation
Closed As
Get back later
Closed As
Grooming
Closed As
Insufficient data
Closed As
Invalid
Closed As
It's all good
Closed As
taiga
Closed As
upstream
day-to-day
dev
docs
easyfix
epel
f26
f27
f28
f29
f30
f31
f32
f33
f34
f35
f36
f37
f38
f39
f40
f41
f42
f43
f44
f45
fedora
groomed
high-gain
high-trouble
in-progress
in-review
investigation
legal
low-gain
low-trouble
mass rebuild
medium-gain
medium-trouble
meeting
mini-initiative
new_artifact
ops
pdc_retirement
rawhide
RCA
review
script
sidetarget
sprint-0
sprint-1
sprint-2
sprint-3
sprint-4
sprint-5
unfrozen
waiting on external
Backlog Status
Needs Review
Backlog Status
Ready
chore
documentation
points
01
points
02
points
03
points
05
points
08
points
13
Priority
High
Priority
Low
Priority
Medium
Sprint Status
Blocked
Sprint Status
Done
Sprint Status
In Progress
Sprint Status
Review
Sprint Status
To Do
Technical Debt
Work Item
Bug
Work Item
Epic
Work Item
Spike
Work Item
Task
Work Item
User Story
Milestone
Clear milestone
No items
No milestone
Projects
Clear projects
No items
No project
Assignees
Clear assignees
No assignees
5 participants
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
releng/tickets!6613
No description provided.