Whenever the taking of any depositions taken in pursuance of section 105 of this title is concluded the opposite party may proceed at once at his own expense to take depositions in his own behalf, at the same time and place and before the same officer: Provided, That he shall, before taking of the depositions in the first instance is entered upon, give notice to the opposing party, or any agent or attorney representing him in the taking of said depositions of his intention to do so.