There was a question on IRC a while ago asking if there was a way to get the remote host's port in the httpd.conf file. This can be achieved by adding a request variable to the expression parser. The variable REMOTE_PORT was added which returns the port information from the client address.
Created attachment 34101 [details] Potential patch
Thanks for the enhancement, added in r1776459 and will propose for backport shortly.