One of the latest examples of success with neural networks is the field of study known as Swarm Intelligence. Even though this field of study has been around for many years, advances in computer hardware combined with our understanding of studying animals has helped us to take this fascinating field out of the laboratory and into many different directions and real-world scenarios.

In this chapter, we are going to cover the following:

• Basic theory on Particle Swarm Optimization, or PSO for short
• The open-source machine-learning framework Encog
• Replacing the conventional back propagation with PSO