All binary files should be included in the LFS system of Git. For doing so, you will need to set your repo to use LFS using this command:
git lfs install
Then you need to manually add the extensions of your binary files like so:
git lfs track "*.uasset"
git lfs track "*.umap"
Your .gitattributes files should look like this now:
*.umap filter=lfs diff=lfs merge=lfs -text
*.uasset filter=lfs diff=lfs merge=lfs -text