April 21, 2020: Suyun and I prepared a review talk on the basics of deterministic MOO: A Review of MultiObjective Optimization: Theory and Algorithms. 
March 4, 2020:
I am sharing the slides of a talk I have been giving recently (IMPA Brazil, Math Lehigh, IE UPitt, and ISE UMinn):
Stochastic Optimization of Multiple Objectives and Supervised Machine Learning.

December 22, 2019:
A new paper is out. There is a new method to model Newton directions when using Hessianvector products that seems quite promising! Check out the details: 
November 8, 2019: A new PhD student started her thesis work under my supervision in September 2018: Suyun Liu. The work has started more than a year ago but the announcement was forgot... Suyun has been working on stochastic multiobjective optimization and fairness in machine learning. Soon we will start new projects in conflicting robotic learning and green logistics for mobility and transportation. 
July 9, 2019:
A new paper is out: 
April 22, 2019:
A new paper is out: 
March 14, 2019: MATLAB's pareto search Algorithm for multiobjective optimization without derivatives is based on our direct multisearch approach:

January 19, 2019: I am releasing the Concise Lecture Notes on Optimization Methods for Machine Learning and Data Science. These lecture notes are publicly available but their use for teaching or even research purposes requires citing:
If appropriate, the corresponding source references given at the end of these notes should be cited instead. These lecture notes are displayed in the form of slides for teaching convenience. 
January 19, 2019: I'm restarting the miniblog here, keeping the complete version here. I hope I'll continue to have something interesting to say once in a while... 
July 23, 2018: This year edition of MOPTA is a special one. It is combined with an NSFTRIPODS sponsored three day summer school for doctoral students and the NSFDIMACS sponsored workshop on Optimization in Machine Learning. A great event, not to be missed! 
June 29, 2018: ISMP 2018 is just a fews days away! The International Symposia on Mathematical Programming are the flagship conferences of our dear Mathematical Optimization Society, and the 2018 edition is the 23rd one. ISMPs are held every three years and have been growing recently in size, one reason being the current popularity of Optimization in the Machine Learning community. 
June 11, 2018: The 6th IMA Conference on Numerical Linear Algebra and Optimization will soon be held at the University of Birmingham during July 2729, 2018. This conference series puts together numerical linear algebraists and optimizers following the combination that led to the development of the most efficient methods for numerically solving optimization problems. The Institute for Mathematics and its Applications has been around since 1964 (!)  and its impact in promoting and supporting Applied Mathematics (journals, prizes, conferences, teaching, dissemination) has been so significant, not only in the UK but around the world. 
May 25, 2018:
Lehigh University has officially announced it:
New ISE Department Chair. Here is what I have to say:

May 16, 2018:
Another paper has now been released: 
April 17, 2018:
A new paper is out: 
April 4, 2018: Extremely happy to report that former MS student Afonso S. Bandeira (Courant, NYU) was awarded a fellowship from the Alfred P. Sloan Foundation. No doubt that Afonso (MS from Coimbra and PhD from Princeton) is among those "whose achievements mark them as among the very best scientific minds working today". Congratulations Afonso! 
March 3, 2018: An advertisement to Les Journées SMAIMODE, the French Days on Optimization and Decision Science, the biennial meeting of the special interest group (MODE) of the French Society for Industrial and Applied Mathematics (SMAI). The event will take place from March 28 to March 30, 2018, near Grenoble, France. 
January 1, 2018: Two new PhD students started their theses work under my supervision in September 2017: Ali Moghanni and Lili Song. Ali is looking at probabilistic direct search for blackbox problems and at the application of Optimization in mobile sensing. Lili is studying new secondorder methods having in mind problems arising from Deep Learning. [Note: Ali has changed adviser in March 2018 due to my departure to Lehigh, and is now working with Professor Marta Pascoal.] 
December 9, 2017: The Vienna Graduate School on Computational Optimization is great example of PhD training in Optimization in Europe. It seems able to attract very good students and provide them an intensive training with course instructors from Austria and abroad. 
September 28, 2017: Looking very much forward to the Workshop I: Optimization and Optimal Control for Complex Energy and Property Landscapes, October 26, 2017, part of the Long Program Complex HighDimensional Energy Landscapes, Institute for Pure & Applied Mathematics (IPAM), an NSF Math Institute at UCLA. 
September 9, 2017: Optimization 2017 has just ended past Friday. Optimizations are a success enterprise, and the 2017 edition was as good as any previous one. This time there was a oneday workshop to (quite deservedly) celebrate the 60th anniversary of Professor Luís Gouveia. The new PC Chair (Luís Gouveia) has announced in the closing session that the next edition will happen in 2020 and that it will be organized by Agostinho Agra as OC Chair. 
August 24, 2017: I am back to Univ. Coimbra after a oneyear sabbatical abroad as visiting professor (one month at Sapienza/Rome and ten months at Rice/Houston). I am extremely grateful to the fantastic hospitality, in particular to my hosts Professors Stefano Lucidi and Matthias Heinkenschloss. 
July 3, 2017: It will start in one week the conference FoCM 2017  Foundations of Computational Mathematics, Barcelona, July 1019, 2017. The Workshop on Continuous Optimization will take place during the last three days (July 1719). 
June 18, 2017: Early registration in Optimization 2017 is approaching fast! 
April 25, 2017:
Another paper has now been released: 
April 21, 2017:
A new paper is out: 
March 3, 2017: Yesterday, for my students, I wrote a schematic summary of global rates and worst case complexity (WCC) bounds for the main techniques in smooth continuous optimization. Click here for a picture of my office board. 
February 17, 2017:
Two new papers are out: 
January 24, 2017: 2017 MACHINE LEARNING @ RICE What a great oneday meeting! 
January 10, 2017: There is a new survey paper on DerivativeFree Optimization: A. L. Custódio, K. Scheinberg, and L. N. Vicente, Methodologies and software for derivativefree optimization, Chapter 37 of Advances and Trends in Optimization with Engineering Applications, T. Terlaky, M. F. Anjos, and S. Ahmed (editors), MOSSIAM Book Series on Optimization, SIAM, Philadelphia, 2017. Click here for the PDF file. 
November 4, 2016:
Today Clément W. Royer has very successfully defended his PhD thesis titled
DerivativeFree Optimization Methods based on Probabilistic and
Deterministic Properties: Complexity Analysis and Numerical Relevance
at the Université Toulouse 3 Paul Sabatier in
the Domaine Mathématiques (Mathématiques Appliquées).

October 3, 2016: It is being a privilege to participate at the Colloquium of the Department of Computational and Applied Mathematics of Rice University and at the Scientific Computing Seminars of the Department of Mathematics of the University of Houston. 
August 15, 2016: I am on sabbatical leave from the University of Coimbra during the academic year 2016/2017. I visited Sapienza  Università di Roma for one month this Summer. I am visiting Rice University from August 2016 to May/June 2017. 
July 21, 2016:
Very, very sad news, unfortunately: 
May 29, 2016:
A great day is approaching, that of the beginning of the
Workshop on Nonlinear Optimization Algorithms
and Industrial Applications,
June 24, 2016, The Fields Institute, Toronto,
celebrating the 70th birthday of Professor Andrew R. Conn
(University of Waterloo) then Dr. Andrew R. Conn (IBM T.J. Watson Research Center).
The organizers have put up an excellent program. As they say in the
webpage

April 22, 2016:
Giulio Galvan and Martina Sereni have very successfully defended
their MS theses respectively titled
Optimization methods for recurrent neural networks training and
Feature selection using LASSO sparse optimization methods
at the Department of Information Engineering of the
Università degli Studi di Firenze,
under a cosupervision of Professor Marco Sciandrone and myself.
Their theses committee counted also with Professor Fabio Schoen.
Congratulations to both! 
March 11, 2016: Yesterday, it was held at the IFP School, in Paris, the PhD defense of Benoît Pauwels. It was a pleasure to be participate in the committee (chaired by Professor Grégoire Allaire). Benoît and his PhD advisers (Professors Frédéric Delbos and Serge Gratton) can indeed be congratulated. The thesis is titled Optimisation sans dérivées sous incertitudes à des simulateurs coûteux. Well done! 
February 1, 2016: In his talk mentioned below, Steve drew our attention to a paper by David Donoho (Stanford University) titled 50 Years of Data Science based on a presentation by Professor Donoho at the John W. Tukey 100th Birthday Celebration (Princeton University). I have read Version 1.00, dated Sept. 18, 2015. This manuscript is informative for a wide range of researchers and practitioners dealing with data, whether they do Statistics or Machine Learning or whether they are mathematicians or computer scientists. It is certainly a must for all academic department chairs and deans interested in launching academic programs in Data Science. 
January 18, 2016: Last week, it was held in Toulouse a workshop on Optimization and Data Assimilation, CERFACS, January 1315, 2016, organized by Serge Gratton and Ehouarn Simon, within the CIMI semester on High Performance Linear and Nonlinear Methods for Large Scale Applications. There were great review talks by Yurii Nesterov and Steve Wright on Optimization for Data Science problems! 
December 9, 2015: Diogo Júdice has successfully defended his PhD thesis yesterday, here at the University of Coimbra. The committee unanimously granted him the highest grade (distinção and louvor). His thesis contains the results of the paper R. Garmanjani, D. Júdice, and L. N. Vicente, Trustregion methods without using derivatives: Worst case complexity and the nonsmooth case, preprint 1503, Dept. Mathematics, Univ. Coimbra, but it has also a worst case complexity analysis of trustregion methods without derivatives for the determination of secondorder stationary points. 
September 24, 2015: Two Italian master students have arrived in Coimbra last week. Their names are Giulio Galvan and Martina Sereni, and both have a BS on Information Technology from the Università degli Studi di Firenze. Professor Marco Sciandrone and I will coadvise their theses. They are staying here for 3 months as ERASMUS students and then will defend their theses in Firenze. Giulio will work on learning of recurrent artificial neural networks. Martina will address nonlinear feature selection/ranking problems and nonlinear LASSO type algorithms. 
August 3, 2015: I am on vacation... from academic bureaucracy! I am reading "Évariste", a historical novel based on the life of Évariste Galois (par FrançoisHenri Désérable, chez Gallimard, 2015). 
July 26, 2015:
In the seventies/eighties, papers on algorithms for
nonlinear optimization would start by "local convergence",
and in the eighties/nineties by "global convergence".
At that time, there was a huge excitement about polynomial
complexity of interiorpoint methods. I still remember well
Professor Richard Tapia saying once in class that such a polynomial
complexity was a qualified form of global convergence
(indeed the starting point was arbitrary).

July 17, 2015: Yet another conference, MOPTA  Modeling and Optimization: Theory and Applications 2015, to be held at Lehigh University. Looking forward... 
July 12, 2015: The 22nd International Symposium on Mathematical Programming will start very soon... 
July 9, 2015:
The issue of vi brings me to this post, the last conference attended,
and what a conference!
Dr. Iain Duff has been organizing the Sparse Days at CERFACS for two decades.
Three editions of the series were held in SaintGirons, close to the Pyrénées.
A large number the most prominent researchers in Numerical Linear Algebra
attended the very last one of these, the
Sparse Days in St Girons III.
Interacting with them, within the scientific program and over fantastic
dinners, was indeed quite an experience! 
July 9, 2015: Zaikun (Zhang) read my post below and suggested me to include mutt (linux mail reader). Yes, I do use mutt, mainly because I can then edit with vi! 
June 16, 2015: Some folks have been asking why don't I start a 'real blog' instead? Well, writing using a university server has plenty of advantages. First, I avoid writing stuff that embarrasses myself, or upsets my department chair or dean. Then, I edit html using vi... What would the world be without stuff like vi or emacs, TeX, scripting, fortran, C++ ... ? 
May 27, 2015: Next week I am giving a seminar talk at the Séminaire Pluridisciplinaire d'Optimisation de Toulouse (SPOT) / Multidisciplinary Optimization Seminar in Toulouse (SPOT). Toulouse is one of the best places to do Optimization in the world! 
May 6, 2015:
Former MS student Afonso Bandeira will join the
Courant Institute of Mathematical Sciences
of NYU as an Assistant Professor in the
Department of Mathematics, with a joint
appointment in the NYU Center for Data Science.
As this will only happen in the Summer of 2016,
Afonso will spend the next academic year
in the Department of Mathematics of MIT as an
Instructor of Applied Mathematics.
Congratulations Afonso!
His PhD thesis will be defended later this month in the PACM
of Princeton University. 
April 28, 2015: The Council of the Mathematical Optimization Society (MOS) approved the nomination made by MOS Chair William J. Cook, and as a result I am the new Chair of the Executive Committee of the society. I look forward to helping Bill and the society! 
April 23, 2015:
Very, very sad news, unfortunately: 
April 22, 2015: According to Google, my webpage is clearly not mobilefriendly. It has failed pretty badly in the MobileFriendly Test... 
April 15, 2015: Luís Daniel Abreu is giving a talk in Coimbra next Wednesday, April 22 (16:30, Room 5.5 of the Math. Dept.) titled Harmonic Analysis for the Natural Sciences. It will be a pleasure to listen to his talk. Daniel was our colleague here at the faculty of the Math. Department and teamed up with us in several research grants. Daniel moved to Vienna a couple of years ago. Early this year, he became a Research Associate at the Acoustics Research Institute of the Austrian Academy of Sciences. 
April 8, 2015: Youssef Diouanne successfully defended his PhD thesis in October 2014 at the Institut National Polytechnique de Toulouse (École ENSEEIHT). Serge Gratton and I supervised his dissertation, titled Globally Convergent Evolution Strategies with Application to an Earth Imaging Problem in Geophysics. After a short postdoc at CERFACS with Serge, Youssef was offered and accepted an academic tenure track position at the Institut Supérieur de l'Aéronautique et de l'Espace (ISAE) at Toulouse. Il s'agit d'un poste d'enseignantchercheur en mathématiques appliquées, spécialité optimisation numérique. Congratulations Youssef! 
April 1, 2015: The Second Seville Workshop on MINLP has counted with more than seventy participants! The meeting was (partially) funded by the EU Action/Project COST TD1207, titled "Mathematical Optimization in the Decision Support Systems for Efficient and Robust Energy Networks". The existence and success of this project is mainly due to Professor Andrea Lodi (Univ. Bologna) who has been its leader (PI) from the beginning. Andrea has told us that he accepted a professorship position at the École Polytechnique de Montréal. Europe lost another fine scientist. Montréal got another great Mathematical Optimizer! 
March 24, 2015: Next week, it will be held in Seville, Spain, the Second Seville Workshop on MINLP. Not all speakers are from Europe or will directly address Mixed Integer Nonlinear Programming in their talks (as it is my case), but the program does show the current European excellence in MINLP. 
March 19, 2015: In the paper Direct search based on probabilistic descent (see papers), there is a new proof technique for establishing global rates and worst case complexity bounds for randomized algorithms for which the new iterate depends on some object (directions, models) and the quality of the object is favorable with a certain probability. The technique is based on counting the number of iterations for which the quality is favorable and examining the probabilistic behavior of this number. 
March 19, 2015: I'm starting a miniature blog here... I hope I'll have something interesting to say once in a while... 
Return to the page of Luis Nunes Vicente.