Justin Antoine, 31, was arrested when agents with the task force served a search warrant at 1 Hudson Heights Drive after receiving information of drug sales taking place, said Frank Tasciotti, assistant coordinator of the task force.
During the search, agents recovered approximately one-half ounce of cocaine, the assault rifle and shotgun, Tasciotti said.
He was charged with criminal possession of a controlled substance and criminal possession of a weapon, police said.
Antoine is being without bail at the Dutchess County Jail. Additional charges may be pending.
To follow @DVDutchess, Daily Voice Dutchess on Twitter, click here.
To follow @PutnamDV, Putnam Daily Voice on Twitter, click here.
Click here to follow Daily Voice Northwest Dutchess and receive free news updates.