The biggest security threat banks faces — malware that pervades their online and mobile banking users' devices — is being met by an increasingly sophisticated class of software called clientless malware detection.