It’s fine to use rmdir [dir name] for empty directories.

But if you’re looking to remove a non-empty directory, you need recursion:

rm -rf [dir name]

Use with caution — you will not be prompted to verify!