Hi
I think thats how CRM works. When a workflow is executed, CRM record is updated by workflow.
As a workaround for your scenario :
Look for Owner of the Case instead of Modified by.
You can also enable Auditing to see who did changes to Case, other than Workflow updates.