A couple things.
1) It looks like you are using the wrong physical size fuse. That looks like a 1” fuse (AGX), not a 1 1/4 inch fuse (AGC). That means the one terminal has less contact surface which could raise the resistance, making heat.
2) It looks like the fuse holder on F5 has been worked on or replaced. Make sure the clips have strong spring tension. If they don’t, that also raises the resistance of the connection, causing heat. It could be possible they were replaced with low current capable fuse clips. If you are going with LEDs, that shouldn’t be a problem as you should be able to install a smaller Fuse.
Bottom line is there is no way that fuse and clip should be getting hot with less than 20 amps running through it if it is in proper working order. The fuse should blow before getting that hot, assuming it’s a 20 amp.