The best replacement for neural networks is regression.

The best alternatives to neural networks are rated as following:
★★★★★  regression
★★★★  decision trees
★★★★  logistic regression
★★★  support vector machines
★★★  genetic algorithms
★★  fuzzy logic
★★  expert systems
★★  artificial intelligence
★  regression analysis
  hidden markov models

Your alternative for neural networks is not listed? Suggest!
Speaking about neural networks, one probably shouldn't forget about data mining.

Other search terms related to neural networks and their ratings are:
★★★★★ data mining
★★★★ matlab tutorial
★★ fuzzy logic
genetic algorithms
You have in mind a companion for neural networks and it is not yet here? Propose!



Google Trends

Scale is based on the average worldwide traffic of neural networks in all years. Click on graph for more.
neural networks
regression
decision trees