My problem was to enter the referenced DLL to my project while I was debugging to analyze the mistake that has been created in it.
The solution is : With the DLL you need to make sure
1. it was built in DEBUG mode
2. it has the pdb file with it
Without these 2 you cannot debug the code

When I placed the pdb file in my projects bin folder it worked like a magic .