Specialist lenders see flat demand as industry faces three big challenges