TeslaCamMerge

Contents

• Introduction
• How it Works
• Hardware Needed
• Instructions
• Example Videos
• Screenshots

Introduction

Tesla's in-built dashcam (TeslaCam) creates four separate video files, one each from the front, left, right and rear cameras as of software version 10.0. I built this project to do the following:

1. Use the teslausb project to have the car store videos on a Raspberry Pi Zero W and transfer the recorded videos to a network share when connected to WiFi at home
2. Merge the four videos into one
3. Create a sped-up "fast preview" version of the merged video
4. Show the videos (raw, merged or fast previews) over a web browser
5. Move selected videos to cloud storage (e.g. Google Drive)
6. Auto-delete files older than 30 days (configurable), unless they are moved to another folder for safe-keeping

Update on October 12:

The current verison of this application supports software version 10.0 (2019.32.12.1 or later). If your car is on version 9, please download an older version prior to this date. If you are on Tesla software v10 and you get errors about USB drive too slow, try recreating your teslausb with the Raspbian Buster version.

Update on October 18:

TeslaCamMerge now supports multiple Tesla cars. Each car should have a Pi Zero W in it running teslausb. The CIFS share that each car's teslausb syncs to must be different. TeslaCamMerge will iterate through the footage synced to all those shares and create merged and sped-up versions of the footage, and serve everything on the same website. If you are a multi-Tesla household, I recommend getting teslausb and TeslaCamMerge working on one car first before adding all your vehicles. An example configuration looks like this.

Car	CIFS Share	Footage Location
My car	/samba/user1	/home/user/Footage/My_car
Wife's car	/samba/user2	/home/user/Footage/Wifes_car

With this example setup, the variables in TCMConstants.py should be set to:

Variable	Value
MULTI_CAR	True
CAR_LIST	['My_car', 'Wifes_car']
SHARE_PATHS	['/samba/user1/', '/samba/user2/']

If you want to use a single-Tesla setup, the variables should be set to:

Variable	Value
MULTI_CAR	False
CAR_LIST	[]
SHARE_PATHS	['/samba/user1/']

How it works

The Pi Zero W is always connected to the car's USB port. In there, it presents itself as a USB storage device to the car. The car saves videos to the Pi Zero W's Micro-SD card when sentry events occur, or when the user presses the camera icon on the display. These clips are up to a minute long, and four clips are produced for each minute.

The Jetson Nano is built with the root filesystem on the USB SSD. The Jetson Nano stays at home and is always on and connected to the network. It serves an SMB share. The Jetson Nano hosts a web site that displays the footage saved and merged by this application.

The Pi Zero W connects to the home WiFi network when in range, and tries to access the SMB share on the Jetson Nano. When the share is reachable, the Pi Zero W moves over all recorded files to that share.

When any new files are loaded on the SMB share, this application moves them to a footage location for processing. Once all four clips for any particular timestamp (i.e. front, left, right and rear camera videos) are available at the footage location, this application then merges them into one mp4 file. It then creates a fast preview of the merged clip.

You can easily access all the videos (raw clips from TeslaCam, merged full videos, or fast-preview versions) through a web browser. There is an "Upload" folder on the USB SSD. The web site allows you to easily copy / move files into that "Upload" folder. This application takes any files placed in that "Upload" folder and moves them to cloud storage.

I have an nginx reverse proxy for my home that I set up for other projects. The Jetson Nano's web site for viewing video files is behind that reverse proxy, so I can access my available dashcam footage over the internet. The instructions on this project do not cover how to set up a reverse proxy.

Hardware needed

1. Nvidia Jetson Nano (may work on Raspberry Pi with slight changes, but not tested)
2. Micro-SD card and Micro-USB power supply for the Jetson Nano
3. High-capacity USB SSD, e.g. Samsung T5 1TB
4. Raspberry Pi Zero W
5. Micro-USB to USB cable to plug the Pi Zero W into the car's USB port
6. Tesla car with dashcam functionality

I use a 32GB Micro-SD card on the Jetson Nano, and a 128GB card on the Pi Zero W. The amount of storage you need on the Pi depends on how long you may be away from home.

I chose the Jetson Nano as it does the video merges with ffmpeg 4-5 times faster than a Raspberry Pi 3B+. I have not tested this on a Raspberry Pi 4. The Pi 4 may achieve similar performance as the Jetson Nano at half the price.

Instructions

A. Setup the Jetson Nano

If you are new to the Jetson Nano, start with the Getting Started guide from Nvidia. It is simpler to set up your root filesystem on the USB SSD. To accomplish this, follow the instructions in this Reddit thread. This will set up the root file system on the USB SSD.

1. Flash a Micro-SD card with the Jetson Nano bootloader image
2. Insert the card in the Jetson Nano
3. Flash the USB SSD with the Jetson Nano rootfs image
4. Connect USB SSD, keyboard, mouse, ethernet cable and monitor and power up the Nano
5. Set up a new user and password (in these instructions, you will see this ID as <userid>)

Once these steps are done, you can do the rest of the work on the Jetson Nano either in a terminal window in the GUI, or by setting up SSH.

If you don't like vim as the text editor, install nano with sudo apt install nano on the Jetson Nano. nano comes preinstalled on Raspberry Pi. If you prefer vim, use that instead of nano in the instructions below.

B. Install required software on the Nano

1. sudo apt update
2. sudo apt upgrade
3. sudo apt install ffmpeg samba lsof cutycapt git xvfb

C. Configure samba and set up the SMB share

1. sudo cp /etc/samba/smb.conf{,.backup}
2. sudo nano /etc/samba/smb.conf, uncomment (i.e. remove the ; character at the beginning of) these lines:

	interfaces = 127.0.0.0/8 eth0
	bind interfaces only = yes

3. sudo mkdir /samba
4. sudo chgrp sambashare /samba
5. sudo useradd -M -d /samba/<share-user-name> -G sambashare <share-user-name>
6. sudo mkdir /samba/<share-user-name>
7. sudo chown <share-user-name>:sambashare /samba/<share-user-name>
8. sudo chmod 2770 /samba/<share-user-name>
9. sudo smbpasswd -a <share-user-name> and set your SMB share password
10. sudo smbpasswd -e <share-user-name>
11. sudo nano /etc/samba/smb.conf, scroll to the bottom of the file and add:

# Settings for TM3 dashcam footage
[fdrive]
   path = /samba/<share-user-name>
   browseable = no
   read only = no
   force create mode = 0660
   force directory mode = 2770
   valid users = <share-user-name> @sadmin

12. Add UNIX user ID for this project to the group sambashare with: sudo usermod -a -G sambashare <userid>

D. Setup the locations for the dashcam footage to be stored

This location is different from the SMB share for two reasons: (a) flatten the directory structure for the clips, and (b) prevent making your clips deletable over the SMB share.

1. Create a directory where all your clips will be stored, (e.g. /home/<userid>/Footage with the command mkdir /home/<userid>/Footage
2. Change to that directory using cd /home/userid>/Footage
3. mkdir SavedClips
4. mkdir SentryClips
5. mkdir SavedClips/Raw
6. mkdir SavedClips/Full
7. mkdir SavedClips/Fast
8. mkdir SentryClips/Raw
9. mkdir SentryClips/Full
10. mkdir SentryClips/Fast
11. mkdir Upload
12. mkdir Keep -- footage you manually move into this folder will not be deleted even if it is old

E. Install and set up filebrowser

1. cd ~
2. mkdir log (or any other location you want your log files in)
3. curl -fsSL https://raw.githubusercontent.com/filebrowser/get/master/get.sh | bash
4. ifconfig and note the LAN IP address of your Jetson Nano. In your home router, given your Jetson Nano a fixed LAN IP.
5. filebrowser config init -a <LAN-IP> -b / -r /home/<userid>/Footage/ -l /home/<userid>/log/filebrowser.log --branding.files /home/<userid>/TeslaCamMerge --branding.disableExternal --branding.name "TM3 Footage"
6. filebrowser users add admin admin --perm.admin
7. filebrowser -d /home/<userid>/filebrowser.db
8. On your computer's web browser, go to http://<LAN-IP>:8080/
9. Login as admin (password is admin as you set up in step 6 above), change password
10. Create a new (non-admin) user account and password for routine use of the application

F. Install and configure rclone

If you do not need the ability to upload your videos to the cloud, you can safely skip this section F. If you skip this section, you should also remove tcm-uploadDrive from step 9 in section G below. You can also remove the "Upload" folder set up in step 7 of section D above with rmdir /media/<userid>/<drivename>/Footage/Upload.

1. wget https://downloads.rclone.org/rclone-current-linux-arm.zip
2. unzip rclone-current-linux-arm.zip
3. sudo cp rclone-v????-linux-arm/rclone /usr/local/bin/
4. rclone config and create a remote (e.g. with the name gdrive of type drive, with access of drive.file)
5. rm rclone* to remove unneded files
6. In your cloud (e.g. Google Drive) account, create a folder called TeslaCam for the uploaded videos

G. Install the python scripts and service files

1. cd ~
2. git clone https://github.com/ppamidimarri/TeslaCamMerge
3. cd TeslaCamMerge
4. chmod +x *.py
5. Modify the paths and other entries in TCMConstants.py to match your structure from all the previous steps
6. Once all paths are correct, run python3 CreateServiceFiles.py, then verify that the service files have been updated with your information (e.g. verify that tcm-mergeTeslaCam.service has the correct Unix user ID and correct path to MergeTeslaCam.py)
7. sudo cp *.service /lib/systemd/system
8. sudo systemctl daemon-reload
9. sudo systemctl enable tcm-loadSSD tcm-mergeTeslaCam tcm-startFileBrowser tcm-uploadDrive tcm-removeOld tcm
10. sudo reboot
11. systemctl status tcm-* and verify that all the services show up as active (running)

You can stop all the services together with sudo systemctl stop tcm and start them all together (in the correct sequence) with sudo systemctl start tcm. You can also start or stop any service individually.

Now you are done with setting up your Jetson Nano!

H. Make your logs visible over the website

You can check the logs of the TeslaCamMerge application in LOG_PATH in TCMConstants.py after logging in to your device over SSH. You can choose to make these logs visible over the web for easier access. I had this enabled only while debugging, as it may be risky to expose these logs over the web without needing to SSH in first. If you really want to do this, the steps are below:

1. Go into your footage path, e.g. cd ~/Footage
2. Create a symbolic link to your log path there, e.g. ln -s ~/log .

Once you have your setup working reliably and you are no longer looking at the logs regularly, you may disable this by deleting the link with rm log in the footage directory.

I. Configure your Pi Zero W

Follow the one-step setup instructions with the pre-built image and the Jetson Nano as the share server, and the username and password for the SMB share you have set up above.

J. Make your footage accessible over the internet

This is an optional step. You can access your videos using a browser on your phone or computer at home. If you want to access them over the internet, you need to set up a reverse proxy. You can set up the reverse proxy on the same Jetson Nano or Raspberry Pi you run this project on (but not the Pi Zero W). I use nginx for the reverse proxy, and here is an outline of how to get it going. Please research how to set up a secure reverse proxy before doing this.

1. sudo apt install nginx
2. On your main router, assign a fixed LAN IP address to the device running the website.
3. On your main router, forward ports 80 and 443 to that fixed LAN IP address.
4. Identify your WAN IP address. You can do this by googling "what's my IP" in a browser. Let's say it is 123.234.213.120. Try the URL http://123.234.213.120/ from your phone with the phone not on your home WiFi (turn the phone's WiFi off for this test). That way you are trying to reach your reverse proxy server from the internet, not your home network. You should see a "Welcome to nginx" page.
5. Then edit sudo nano /etc/nginx/sites-available/default to add a new location block with a proxy_pass line. Details here. Example:

location / {
	proxy_pass http://192.168.1.16:8080/;
}

7. Restart nginx.
8. Try accessing http://123.234.213.120/ on your phone with WiFi off.
9. If the above test worked, then try it in the car browser. Bookmark the page in the car browser.

If your URL for external access has a location after the / (e.g. http://123.234.213.120/footage), you need to stop the startFileBrowser service and then update filebrowser configuration with filebrowser config set -b /footage.

Your WAN IP address may be dynamic -- that is at your ISP's discretion. If it is, saving a bookmark with the number will stop working when the ISP gives you a new WAN IP. To get around this, you need to jump through a few more hoops.

1. Select a dynamic DNS service. I picked NoIP.com.
2. Create a domain there. Many services let you set up a free subdomain (e.g. myteslacam.ddns.net).
3. On the device running this project (not the Pi Zero W in the car), install the dynamic update client provided by the dynamic DNS service you picked. This service will ping the service provider once every so often and tell them, "hey, my IP address is x.x.x.x." When the service provider sees a change in the IP address, they change their DNS records so that when you try to reach myteslacam.ddns.net over the internet, it will be routed to your new WAN IP.
4. Now try your new URL in the car (e.g. http://myteslacam.ddns.net/). Bookmark it!

If you decide to do all this, I highly recommend securing your reverse proxy server by forcing SSL on all requests and getting your own SSL certificate. There is a lot of documentation out there on how to secure an nginx server.

Example Videos

Fast preview video

Full merged video

Screenshots

Desktop browser view of the website

Login screen:

Main page:

Folder view:

List view:

Video view:

Statistics view:

Bad videos that ffmpeg can't process:

File size mismatches:

Mobile browser view of the website

Main page:

Menu:

Folder selection:

Folder view:

Video selection:

Share feature:

File information:

Video view:

Statistics view:

Bad videos that ffmpeg can't process:

Videos with big size variations: