Last updated on 22 December 2024
Important or Recent Updates
Update | Date |
---|---|
New guide released | 21/01/2024 |
Addition of UID/GID to the Redis container | 19/08/2024 |
General compatibility announcement | 20/12/2024 |
As of the update on 20/12/2024 (Tube Archist v0.4.12) (Tube Archivist Elastic Search 8.16.0) this container will no longer work on DSM with its current Kernel (4.4.xxx). This is due to the Elastic Search container now requiring specific kernel security features to function.
A temporary workaround is possible by downgrading the Elastic Search container, This will continue to function for an indefinite amount of time so just be aware if you are setting this up fresh.
image: bbilly1/tubearchivist-es:8.14.3
I won’t archive this guide yet as the container itself could be run via a machine with a newer Kernel version (Lets see what 2025 Synology models bring…)
What is Tube Archivist?
To quote the GitHub page
Once your YouTube video collection grows, it becomes hard to search and find a specific video. That’s where Tube Archivist comes in: By indexing your video collection with metadata from YouTube, you can organize, search and enjoy your archived YouTube videos without hassle offline through a convenient web interface.
This includes:
– Subscribe to your favourite YouTube channels
– Download Videos using yt-dlp
– Index and make videos searchable
– Play videos
– Keep track of viewed and unviewed videos
Let’s Begin
In this guide I will take you through the steps to things up and running in Container Manager. We will be using the new Projects (Docker Compose) feature to get this running as it will save you time vs manual setup using the normal UI
If you have followed my other guides this one is a little different as there is not as much pre setup required just make sure you have followed these first.
Folder Setup
Let’s start by getting some folders set up for the containers to use. Open up File Station create the following.
/data/media/youtube
/docker/projects/archivist-compose
/docker/tubearchivist/cache
/docker/tubearchivist/redis
/docker/tubearchivist/es
Folder Permissions
Next we need to get under the covers with DSM and set some specific file permissions for a couple of the folders we just created. This is because the Redis and Elasticsearch containers only run as specific users and can’t be overridden, without this step Tube Archivist can’t start up.
Just like you did in the Docker User Setup guide you need to SSH into your NAS and then run the following commands in order to set the permissions. As we are doing this as the ‘root’ user you will be asked for your password the first time you run the command.
sudo chown 1000:0 /volume1/docker/tubearchivist/es
sudo chown 999:100 /volume1/docker/tubearchivist/redis
You will not see any output after each command and in File Station you should now see the permissions on the folders have changed.
Container Manager
Next we are going to set up a ‘Project’ in Container Manager. Open up Container Manager and click on Project then on the right-hand side click ‘Create’.
In the next screen we will set up our General Settings, enter the following:
Section | Setting |
---|---|
Project Name: | tubearchivist |
Path: | /docker/projects/archivist-compose |
Source: | Create docker-compose.yml |
Next we are going to drop in our docker compose configuration, copy all the code in the box below and paste it into line ‘1’ just like the screenshot.
services:
tubearchivist:
container_name: tubearchivist
image: bbilly1/tubearchivist
ports:
- 8000:8000/tcp
volumes:
- /volume1/data/media/youtube:/youtube
- /volume1/docker/tubearchivist/cache:/cache
environment:
- ES_URL=http://archivist-es:9200
- REDIS_HOST=archivist-redis
- HOST_UID=1234 #CHANGE_TO_YOUR_UID
- HOST_GID=65432 #CHANGE_TO_YOUR_GID
- TA_HOST=192.168.0.10 #Change to your NAS IP
- TA_USERNAME=enter-a-username #Username for login
- TA_PASSWORD=enter-a-password #password for login
- ELASTIC_PASSWORD=enter-a-password # set password for Elasticsearch
- TZ=Europe/London #CHANGE_TO_YOUR_TZ
depends_on:
- archivist-es
- archivist-redis
healthcheck:
test: ["CMD", "curl", "-f", "http://localhost:8000/health"]
interval: 2m
timeout: 10s
retries: 3
start_period: 30s
security_opt:
- no-new-privileges:true
restart: always
archivist-redis:
image: redis/redis-stack-server
container_name: archivist-redis
expose:
- "6379"
environment:
- HOST_UID=999
- HOST_GID=100
volumes:
- /volume1/docker/tubearchivist/redis:/data
depends_on:
- archivist-es
security_opt:
- no-new-privileges:true
restart: always
archivist-es:
image: bbilly1/tubearchivist-es
container_name: archivist-es
environment:
- ES_JAVA_OPTS=-Xms512m -Xmx512m
- xpack.security.enabled=true
- discovery.type=single-node
- path.repo=/usr/share/elasticsearch/data/snapshot
- ELASTIC_PASSWORD=password-from-above #same password from above
ulimits:
memlock:
soft: -1
hard: -1
volumes:
- /volume1/docker/tubearchivist/es:/usr/share/elasticsearch/data
expose:
- "9200"
security_opt:
- no-new-privileges:true
restart: always
Environment Variables
We are now going to amend some key variables to make sure the containers have access to our folders, and also knows where we are in the world and set up some passwords. Don’t change any other settings other than those I mention.
You will notice that the compose has three main sections as it is made up of 3 containers which rely on each other to make the overall app work.
image: bbilly1/tubearchivist
(Main Tube Archivist container)
image: redis/redis-stack-server
(Redis database server)
image: bbilly1/tubearchivist-es
(Elasticsearch search and analytics engine)
Let’s change the settings for them one at a time.
bbilly1/tubearchivist
Variable | Value |
---|---|
HOST_UID | (required) The UID you obtained in the user setup guide |
HOST_GID | (required) The GID you obtained in the user setup guide |
TA_HOST | Enter your NAS IP Address here |
TA_USERNAME | Create a username for your login |
TA_PASSWORD | Create a password for your login |
ELASTIC_PASSWORD | Create a different password for the Elastic Search container |
TZ | (required) Your timezone wikipedia.org/wiki/List_of_tz_database_time_zones |
redis/redis-stack-server
No amendments required
bbilly1/tubearchivist-es
Variable | Value |
---|---|
ELASTIC_PASSWORD | The same elastic password from the section above |
Once you have made the edits you can click ‘Next’
You do not need to enable anything on the ‘Web portal settings’ screen click ‘Next’ again.
On the final screen click ‘Done’ which will begin the download of the container images and once downloaded they will be launched!
The image will now be downloaded and extracted. You should see ‘Code 0’ when it has finished.
The first ever start up can take a few minutes so be patient while everything sets up, so in the interim continue below.
Firewall Exceptions
(Skip if you don’t have the Firewall configured)
If you have the Synology Firewall enabled please see this additional guide for further info on exceptions and correct set up.
Some final steps
Tube Archivist will now be running and can be found on port 8000 on your NAS IP
e.g. 192.168.0.40:8000
You should be able to log in using the Username and Password you set up in the yaml earlier
There are no other changes we need to make to the default configuration, however you can go in and make changes to your preferences.
Some key things I have found from a UI perspective.
Channels, probably fairly obvious but add the URLs for full channels you want to subscribe to in this section, you can configure Archivist to then download all the back catalogue and future videos.
Downloads, I use this to grab individual videos using the + button on the right-hand side.
Make sure you have a look at the documentation over on the Tube Archivist site.
https://docs.tubearchivist.com/
Browser Extension
https://github.com/tubearchivist/browser-extension
Looking for some help, join our Discord community
If you are struggling with any steps in the guides or looking to branch out into other containers join our Discord community!
Buy me a beverage!
If you have found my site useful please consider pinging me a tip as it helps cover the cost of running things or just lets me stay hydrated. Plus 10% goes to the devs of the apps I do guides for every year.
Hi! Firstly, thanks for your awesome guides.
I’ve successfully built the project and according to the TA container log there are no errors, however I’m unable to login to the web portal. I’ve tried several username/password combinations but it’s still giving me “Failed to Login.”
Any ideas?
Did you adjust the username and password originally in the yaml config, if so and that is not working stop the Project, delete the contents of the tubearchivist folder and start the Project again. This will flush out like it’s a fresh installation based on what you enter on these two lines.
– TA_USERNAME=enter-a-username #Username for login
– TA_PASSWORD=enter-a-password #password for login
Anyone get the plex integration working?
https://github.com/tubearchivist/tubearchivist-plex
Can’t seem to get the plugin to show up.
I can get it to show up (make sure you renamed it in one of the first steps), but it won’t see my data. Logs say it cannot read the json file.
Hi,
I had to use the command:
sudo chown 1000:1000 /volume1/docker/tubearchivist/es
instead of:
sudo chown 1000:0 /volume1/docker/tubearchivist/es
Thought it might help someone else.
Weird, gotta love permissions! I will keep an eye if anyone else has an issue.
Is there a reason that synobridge network is missing for this one? 🙂
Hey Matt
It’s not really needed for this container as it is not talking to the others on the synobridge, it creates it own.
but what if it can’t create it’s own. That’s what my issue is for a lot of these. It won’t create it’s own network and then crashes
As we don’t specify one it will be created by Docker that’s the key, if no network_mode is specified Docker will always create an associated bridge for the required ports.
This is one of my favorite projects I selfhost. If not THE favorite. I spent a few years downloading videos from YT using custom scripts wrapping yt-dlp and it was time consuming. I looked at other self-hosted yt-dlp-wrappers but nothing seemed to tickle my fancy. Until TA came along.
Amazing project, responsive maintainer and good support on the Discord.
The only downside is that it is now so easy to save videos that I have turned into even more of a datahoarder then I already was!
Ha, I know the feeling, been grabbing some music channels and its sucking up space fast! I will be throwing some money the projects way!