Brian J. Taylor

Graduate Student
Department of Computer Science
University of Massachusetts Amherst

Email:   btaylor at cs dot umass dot edu
Phone:  413.545.1519
Fax:      413.545.1249
Address: Computer Science Research Center
               University of Massachusetts
               140 Governors Drive
               Amherst, MA 01003-9264

[Research]    [Publications]    [Recent CV]


About Me

I am in my second incarnation as a graduate student. I graduated in 1999 from West Virginia University (WVU) with an M.S. in electrical engineering, but my focus was on software engineering. I investigated the safety-critical aspects of adaptive systems like neural networks, and how we could apply software engineering techniques like Verification and Validation to them.

After the MSEE I went to work at the Institute for Scientific Research, Inc. (ISR) (now a part of the West Virginia High Technology Consortium Foundation), a small WV research company. For ISR I was involved with several projects on intelligent flight control for the NASA Dryden Flight Research Center, NASA Ames Research Center, and the NASA IV&V Facility. I continued studying engineering practices on adaptive systems, leading research teams, and finally developing two guides to help other engineers and scientists working in this area.

I decided that I wanted to be a better researcher and scientist so I went back to grad school to pursue a PhD in computer science. I am now a student at the University of Massachusetts Amherst working in the Knowledge Discovery Laboratory under David Jensen. My interests have evolved and I conduct research in the area of machine learning, specifically relational learning and causal knowledge discovery. As an engineer, I still have a love for systems development and much of my work tries to bring engineering and science together.


Current Research Interests

Causal Knowledge Discovery

I am part of a KDL team working to create a system that enables causal knowledge discovery. Our first approach was the identification of quasi-experimental designs (QEDs) from static, observational data. QEDs are traditionally found through manual, time-consuming means. Our automated system is able to find large numbers of possible QEDs and then reduce that number through analysis of dependencies in the data, generating a list of highly likely candidates for good QEDs. Our current work is a larger system that will identify a larger set of potential experimental designs including QEDs. The software can then automatically apply these designs and build a causal model over the data set through an iterative process.

Peer Production/Collaborative Systems

I have developed a small research platform to investigate peer production and collaborative sensing systems called Photobase. These are systems where people come together to generate or gather content that is then used and shared by the community. Wikipedia is an example. Photobase allows us to experiment while participants use the system so we can evaluate what influences and effects their behavior and levels of participation. The Photobase design and experimental controls enable strong causal inference. For example I have already found that when participants view the collaboration as a competition, they actually participate less frequently than those who do not. The study also suggests that for any participatory system that includes areas infrequently traveled will either need to rely on a very large and carefully selected participant list or the use of coordination to guarantee coverage.

Relational Learning

The first area I began to research at UMass was the area of machine learning, specifically relational learning algorithms and graphical models. I've been investigating the relational probability tree (RPT) and the relational dependency network (RDN) and looking at how different characteristics of a data set can bias the learning algorithms. Biases like relational autocorrelation and degree dependency can influence relational learning algorithms and cause them to believe there is knowledge within the data that is not present. So far I have worked on:

  • Identifying fradulent behavior among brokers who are licensed by the Financial Industry Regulatory Authority (FINRA), formerly NASD.
  • Applying relational learning techniques to clusters of individuals and movies to predict movie preferences for the Netflix Prize competition.
  • Improving the RDN algorithm by incoporating randomization tests and Gibbs sampling and correcting for relational autocorrelation and degree dependency biases.

Past Research Interests

Verification and Validation of Adaptive Systems

I've investigated the techniques necessary to use adaptive systems, primarily neural networks, in highly critical applications such as commercial jetliners, space exploration, and power generation. Neural networks are an approach that no longer receive as much attention, but very little has been done on them to make them practical. Would you trust a neural network in your car that augmented your braking ability? Do you know for sure that as the network learns or when it compensates that it is safe and won't cause you to suddenly veer out of control? What are the verification and validation techniques we need to develop and use to make sure neural network technology is safe so that it can be used in systems that directly impact human lives or expensive equipment? Techniques that I have explored include formal proofs of neural network safety, mathematical and statistical approaches to study neural network safe adaptation, and development of engineering practices like testing techniques.


Publications

Thesis

Photobase - A Research Platform to Investigate Peer Production and Collaborative Sensing Systems.
Brian J. Taylor, Computer Science Department, University of Massachusetts, Amherst, MA, May 2008.

Regressive Model Approach to the Generation of Test Trajectories.
Brian J. Taylor, Department of Computer Science and Electrical Engineering, West Virginia University, WV, December 1999.

Books

Methods and Procedures for the Verification and Validation of Artificial Neural Networks.
Brian J. Taylor Editor. Springer. 2005.

Guidance for the Verification and Validation of Neural Networks.
Laura L. Pullum, Brian J. Taylor, Marjorie A. Darrah. Wiley IEEE Computer Society. March 2007.

Journal Articles

Independent Verification and Validation of Neural Networks Developing Practitioner Assistance.
Laura L. Pullum, Marjorie A. Darrah, and Brian J. Taylor. Software Tech Newsletter 8(2):11-14. 2004.

Automated Generation of Test Trajectories for Embedded Flight Control Systems.
Boja Cukic, Brian J. Taylor, Harshinder Singh, International Journal of Software Engineering and Knowledge Engineering, Vol. 12, No. 2, pp. 175-200. 2002.

Characterization of Poly(phenylsilsesquioxane) Thin film Planar Optical Waveguides.
Kolin S. Brown, Brian J. Taylor, Larry A. Hornak, and T. W. Weidman, IEEE Photonic Technology Letters, vol.9(6), pp. 791 793, June 1997.

Conference Papers

Building Better Participatory Sensing Systems.
Brian J. Taylor, Ryan Rossi, Mark Corner, David Jensen. In preparation for submission.

Automatic Identification of Quasi-experimental Designs for Discovering Causal Knowledge.
David Jensen, Andrew Fast, Brian Taylor, and Marc Maier. Proceedings of the 14th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, Las Vegas, Nevada, August 24 - 27, 2008.

Relational Data Pre-processing Techniques for Improved Securities Fraud Detection.
Andrew Fast, Lisa Friedland, Marc Maier, Brian Taylor, David Jensen, Henry G. Goldberg, and John Komoroske. Proceedings of the 13th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, San Jose, CA, August 12 - 15, 2007.

Rule Extraction as a Formal Method for the Verification and Validation of Neural Networks.
Brian J. Taylor, Marjorie Darrah. International Joint Conference on Neural Networks (IJCNN05). Montreal, Quebec, Canada, July 31 - August 4, 2005.

A Geometric Rule Extraction Approach used for Verification and Validation of a Safety Critical Application.
Marjorie Darrah, Brian Taylor and Michael Webb. 18th Annual Florida Artificial Intelligence Research Society Conference, Clear Water Beach, FL, May 16-18, 2005.

Weaving it All Together - A Methodology for the Verification and Validation of Adaptive Neural Networks.
Brian J. Taylor, Marjorie Darrah, Spiro Skias. NIPS-2004 Workshop on Verification, Validation, and Testing of Learning Systems. Whistler, British Columbia, Canada, December 2004.

Rule Extraction From Dynamic Cell Structure Neural Network Used in a Safety Critical Application.
Darrah, Marjorie, Brian Taylor and Spiro Skias. In Proceeding of Florida Artificial Intelligence Research Society Conference, Miami FL, May 17-19, 2004.

Verification and Validation of Neural Networks: A Sampling of Research in Progress.
Brian J. Taylor, Marjorie A. Darrah, Christina Moats. SPIE's 17th Annual International Symposium on Aerospace/Defense Sensing, Simulation, and Controls (AeroSense 2003), Orlando, FL, April 21-25, 2003.

Evaluation of Regressive Methods for Automated Generation of Test Trajectories.
Brian J. Taylor, Bojan Cukic, Proceedings of the 11th International Symposium on Software Reliability Engineering ISSRE 2000, San Jose CA, pp. 97-109, October 8-11, 2000.

Regressive Model Approach to the Generation of Test Trajectories.
Brian J. Taylor, Bojan Cukic, Proceedings of the 3rd IEEE Symposium on Application-Specific Systems and Software Engineering Technology ASSET 2000, Richardson, Texas, pp. 49-56, March 24-25, 2000.

Polymer Waveguide Cointegration with Microelectromechanical Systems (MEMS) for Integrated Optical Metrology.
Kolin S. Brown, Brian J. Taylor, Jeremy M. Dawson, and Larry A. Hornak, SPIE Photonics West Symposium, Miniaturized Systems with Micro-Optics and Micromechanics III, San Diego, CA, pp. 112-122. January 1998.

Characterization of Poly(phenylsilsesquioxane) (PPSQ) for Planar Integrated Optical Waveguide Applications.
Kolin S. Brown, Brian J. Taylor, Larry A. Hornak, and T. W. Weidman, SPIE Photonics West Symposium, Optical Interconnects and Packaging IV, San Jose, CA, pp. 163 169. February 1997.

Polymer Guided Wave Integrated Optics: An Enabling Technology for Micro Opto Electro Mechanical Systems.
Larry A. Hornak, Kolin S. Brown, Brian J. Taylor, and J. C. Barr, SPIE Photonics West Symposium, Micro Optics and Micromechanics II, San Jose, CA, pp. 124 135. February 1997.

Tech Reports

Methods and Procedures for the Independent Verification and Validation of Neural Networks.
Brian J. Taylor, Marjorie Darrah, Laura Pullum, James T. Smith, Leon Luxemburg, Spiro Skias, and Bojan Cukic. Technical Report prepared by Institute for Scientific Research, Inc. for NASA Independent Verification and Validation Facility under grant NAG5-12069. 2004.

Introduction to the Development of Methodologies for the Independent Verification and Validation of Neural Networks.
Brian J. Taylor, Marjorie Darrah, James T. Smith, Spiro Skias. Technical Report prepared by Institute for Scientific Research, Inc. for NASA Independent Verification and Validation Facility under grant NAG5-12069. 2003.

Toward Reliable Neural Network Software for the Development of Methodologies for the Independent Verification and Validation of Neural Networks.
Brian J. Taylor, Marjorie Darrah, Pat Adams, Brian Stolarik, James T. Smith, Spiro Skias. Technical Report prepared by Institute for Scientific Research, Inc. for NASA Independent Verification and Validation Facility under grant NAG5-12069. 2002.