To delete an OU, you'll need to make sure it's empty by removing its child accounts (as we mentioned previously). You can then go ahead and delete the OU, as follows:

aws organizations delete-organizational-unit 
  --organizational-unit-id <ou-id>