Page MenuHomeTelepedia

Switch file storage to Amazon S3
Closed, ResolvedPublic

Description

Switching our file storage to Amazon S3 will aid in achieveing T26, but will also give us more flexibility. Amazon S3 is also pretty much a lot faster than storing them locally. This means that both sitemaps and images can be served through S3, and also database dumps.

Revisions and Commits

Event Timeline

OriginalAuthority renamed this task from Switch images to Amazon S3 to Switch file storage to Amazon S3.Jun 22 2023, 12:10 PM
OriginalAuthority changed the task status from Open to In Progress.
OriginalAuthority triaged this task as Normal priority.
OriginalAuthority created this task.
OriginalAuthority updated the task description. (Show Details)
OriginalAuthority added a commit: Unknown Object (Diffusion Commit).Jun 22 2023, 1:48 PM

I've managed to set up the bucket, and it correctly handles uploads and deletions. There does appear to be an issue with accessing files, however, when using a custom URL. I'll keep investigating, but it shouldn't be too long until this can be marked as compelete.

The back-end of this is largely done. All that remains is to turn off uploads temporarily and move the files across to the bucket. Afterwards, wikis will need to change their URLs in ManageWiki for logos or anything else like that because they will be served via static.telepedia.net rather than {$wgDBname}.telepedia.net/images/{$wgDBname}.

OriginalAuthority claimed this task.
OriginalAuthority added a commit: Unknown Object (Diffusion Commit).