Cannot connect when run through HaProxy

[burrsg101 3]

Hello all, 

I'm hoping someone with experience with HaProxy can maybe help figure out what I'm missing. I have been running Emby with direct port forwarding fine for some time, but I decided I would like to put it behind a reverse proxy for a few different reasons. I am running HaProxy in Pfsense to achieve this. I cannot however get it to complete the connection.

My setup is as follows:
SSL offloading in HaProxy frontend

Backend runs to my Linux box IP that has Emby on the normal http port 8096

I have a cert dedicated to my domain (not wild card) that I run emby in. I've verified this is being pull correctly on the front end. My issue starts on the backend. The connection requests to Emby are being rejected. I have verified the requests are making it to the Linux box with Emby running on it using wireshark. See the capture here:

 

This is where I get lost as I cannot figure out why these are getting rejected.

These are my network settings in Emby server:

 

Haproxy just shows a connection failure. If I try to run a health check in Haproxy, it too tell me there is a layer4 refusal and presumes the server to be down. The following is the message I get in the logs in HaProxy:

Also I have an unrelated web server (standard Apache server) running in a different VM on the same VLAN as my emby server that has connection perfectly fine with HAproxy, and no issues.

Any help is much appreciated.